Inferact: Building the Infrastructure That Runs Modern AI

Inferact is a new AI infrastructure company founded by the creators and core maintainers of vLLM. Its mission is to build a universal, open-source inference layer that makes large AI models faster, cheaper, and more reliable to run across any hardware, model architecture, or deployment environment. Together, they broke down how modern AI models are actually run in production, why “inference” has quietly become one of the hardest problems in AI infrastructure, and how the open-source project vLLM emerged to solve it. The conversation also looked at why the vLLM team started Inferact and their vision for a universal inference layer that can run any model, on any chip, efficiently.

Follow Matt Bornstein on X: https://twitter.com/BornsteinMatt

Follow Simon Mo on X: https://twitter.com/simon_mo_

Follow Woosuk Kwon on X: https://twitter.com/woosuk_k

Follow vLLM on X: https://twitter.com/vllm_project

Check out everything a16z is doing with artificial intelligence here, including articles, projects, and more podcasts.

Please note that the content here is for informational purposes only; should NOT be taken as legal, business, tax, or investment advice or be used to evaluate any investment or security; and is not directed at any investors or potential investors in any a16z fund. a16z and its affiliates may maintain investments in the companies discussed. For more details please see a16z.com/disclosures.

Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.

Kokeile Premiumia

Nauti 14 päivää ilmaiseksi

Tilaa Premium

Jaksot(81)

How AI Will Change Photography Forever

What if you could retake your favorite memories years after they happened, fixing the lighting, catching the smile, or even opening your eyes?In this conversation, a16z General Partner Martin Casado a...

17 Syys 202551min

How OpenAI Built Its Coding Agent

OpenAI’s Codex has already shipped hundreds of thousands of pull requests in its first month. But what is it really, and how will coding agents change the future of software?In this episode, General P...

29 Elo 20251h 19min

Models, Modalities, and Memes: Creating Compelling AI Characters

Models, Modalities, and Memes: Creating Compelling AI CharactersIn this episode of AI + a16z, Hedra founder and CEO Michael Lingelbach joins a16z partners Justine Moore and Matt Bornstein to talk abou...

14 Elo 202547min

Performance and Passion: Fal's Approach to AI Inference

If you've been experimenting with image, video, and audio models, the chances are you've been both blown away by how good they're becoming, and also a little perturbed by how long they can take to gen...

1 Elo 202540min

How to Vibe Code Securely

In this episode, a16z partner Joel de la Garza sits down with Socket founder and CEO Feross Aboukhadijeh to dive into the intersection of vibe coding and security. As one of the earliest security foun...

25 Heinä 202526min

AI Is Upending SaaS Pricing

In this episode, a16z GP Martin Casado sits down with Metronome CEO Scott Woody to unpack how AI is fundamentally changing the value proposition of software—and why that shift demands a rethink of the...

18 Heinä 202542min

The AI Infrastructure Stack with Jennifer Li

In this episode, which originally aired on the Complex Systems Podcast, a16z General Partner Jennifer Li discusses how AI is reshaping every layer of the software stack, creating demand for new types ...

11 Heinä 202545min

AI's Unsung Hero: Data Labeling and Expert Evals

Labelbox CEO Manu Sharma joins a16z Infra partner Matt Bornstein to explore the evolution of data labeling and evaluation in AI — from early supervised learning to today’s sophisticated reinforcement ...

27 Kesä 202546min

Kaikki yhdessä sovelluksessa

Kuuntele kaikki suosikkipodcastisi ja -äänikirjasi yhdessä paikassa.

Sinulle valikoitua sisältöä

Podme-sovelluksessa kokoat suosikkisi helposti omaan kirjastoosi. Saat meiltä myös kuuntelusuosituksia!

Jatka kuuntelua koska tahansa

Voit jatkaa siitä mihin jäit, myös offline-tilassa.

Premium

9,99 €/kk

Kaikki premium-podcastit
Ei mainoksia
Ei sitoutumista, peruuta koska tahansa

Aloita 14 päivän kokeilu

Premium

13,99 €/kk

Kaikki premium-podcastit
Ei mainoksia
Ei sitoutumista, peruuta koska tahansa
Yksi lisäkäyttäjä

Kokeile 14 päivää maksutta

Suosittua kategoriassa Liike-elämä ja talous

Tarinat ja äänet, joita rakastat kuunnella

Kuuntele kaikki suosikkipodcastisi ja -äänikirjasi

Lue lisää