Inferact: Building the Infrastructure That Runs Modern AI
AI + a16z22 Tammi

Inferact: Building the Infrastructure That Runs Modern AI

Inferact is a new AI infrastructure company founded by the creators and core maintainers of vLLM. Its mission is to build a universal, open-source inference layer that makes large AI models faster, cheaper, and more reliable to run across any hardware, model architecture, or deployment environment. Together, they broke down how modern AI models are actually run in production, why “inference” has quietly become one of the hardest problems in AI infrastructure, and how the open-source project vLLM emerged to solve it. The conversation also looked at why the vLLM team started Inferact and their vision for a universal inference layer that can run any model, on any chip, efficiently.

Follow Matt Bornstein on X: https://twitter.com/BornsteinMatt

Follow Simon Mo on X: https://twitter.com/simon_mo_

Follow Woosuk Kwon on X: https://twitter.com/woosuk_k

Follow vLLM on X: https://twitter.com/vllm_project

Check out everything a16z is doing with artificial intelligence here, including articles, projects, and more podcasts.

Please note that the content here is for informational purposes only; should NOT be taken as legal, business, tax, or investment advice or be used to evaluate any investment or security; and is not directed at any investors or potential investors in any a16z fund. a16z and its affiliates may maintain investments in the companies discussed. For more details please see a16z.com/disclosures.


Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.

Jaksot(90)

Patrick Collison on Stripe’s Early Choices, Smalltalk, and What Comes After Coding

Patrick Collison on Stripe’s Early Choices, Smalltalk, and What Comes After Coding

Michael Truell, CEO of Cursor, sits down with Patrick Collison, CEO of Stripe and an investor in Anysphere, to talk about Collison's history with Smalltalk and Lisp, the MongoDB and Ruby decisions Str...

24 Maalis 52min

OpenClaw: Why the Internet Isn't Built for AI Agents

OpenClaw: Why the Internet Isn't Built for AI Agents

Yoko Li, Guido Appenzeller, and Joel de la Garza discuss OpenClaw, the open source personal AI assistant that's forcing a rethink of how identity, permissions, and security work on the internet. They ...

19 Maalis 47min

What's Missing Between LLMs and AGI - Vishal Misra & Martin Casado

What's Missing Between LLMs and AGI - Vishal Misra & Martin Casado

Vishal Misra returns to explain his latest research on how LLMs actually work under the hood. He walks through experiments showing that transformers update their predictions in a precise, mathematical...

17 Maalis 47min

Replit's CEO on Vibe Coding, Wealth Building, and What Most People Get Wrong About AI

Replit's CEO on Vibe Coding, Wealth Building, and What Most People Get Wrong About AI

Jack Neel speaks with Amjad Masad, CEO at Replit, about how AI is making it easier than ever to build and ship software without a technical background. They discuss Replit's rise from a browser-based ...

10 Maalis 1h 39min

Jack Altman & Martin Casado on the Future of VC

Jack Altman & Martin Casado on the Future of VC

Jack Altman sits down with Martin Casado, General Partner at a16z, to unpack the shifting dynamics of venture capital and why media matters more than ever. They cover a16z’s evolution from generalists...

3 Maalis 53min

AI’s Capital Flywheel: Models, Money, and the Future of Power

AI’s Capital Flywheel: Models, Money, and the Future of Power

a16z's Martin Casado and Sarah Wang join Latent Space hosts Alessio Fanelli and Swyx to discuss what makes this AI investment cycle unlike anything in the history of venture capital. They cover why th...

24 Helmi 57min

Durable Execution and the Infrastructure Powering AI Agents

Durable Execution and the Infrastructure Powering AI Agents

Raghu Raghuram, Managing Partner at a16z, and Sarah Wang, General Partner at a16z, speak with Samar Abbas, CEO of Temporal, about how durable execution became the infrastructure layer behind some of t...

19 Helmi 1h 3min

Evals, Feedback Loops, and the Engineering That Makes AI Work

Evals, Feedback Loops, and the Engineering That Makes AI Work

Martin Casado speaks with Ankur Goyal, founder and CEO of Braintrust, about where engineering actually matters in AI and where it doesn't. They cover the open source vs closed source model cycle, why ...

17 Helmi 43min

Suosittua kategoriassa Liike-elämä ja talous

sijotuskasti
mimmit-sijoittaa
rss-rahapodi
psykopodiaa-podcast
rss-rahamania
herrasmieshakkerit
ostan-asuntoja-podcast
rss-seuraava-potilas
rss-20-30-40-podcast
rahapuhetta
rss-inderes-femme
rss-paasipodi
rss-myynnilla-on-asiaa-kert-kenner
taloudellinen-mielenrauha
rss-sami-miettinen-neuvottelija
yrittaja
raksapodi
rss-lahtijat
rss-startup-ministerio
rss-sisalto-kuntoon