Inferact: Building the Infrastructure That Runs Modern AI
AI + a16z22 Tammi

Inferact: Building the Infrastructure That Runs Modern AI

Inferact is a new AI infrastructure company founded by the creators and core maintainers of vLLM. Its mission is to build a universal, open-source inference layer that makes large AI models faster, cheaper, and more reliable to run across any hardware, model architecture, or deployment environment. Together, they broke down how modern AI models are actually run in production, why “inference” has quietly become one of the hardest problems in AI infrastructure, and how the open-source project vLLM emerged to solve it. The conversation also looked at why the vLLM team started Inferact and their vision for a universal inference layer that can run any model, on any chip, efficiently.

Follow Matt Bornstein on X: https://twitter.com/BornsteinMatt

Follow Simon Mo on X: https://twitter.com/simon_mo_

Follow Woosuk Kwon on X: https://twitter.com/woosuk_k

Follow vLLM on X: https://twitter.com/vllm_project

Check out everything a16z is doing with artificial intelligence here, including articles, projects, and more podcasts.

Please note that the content here is for informational purposes only; should NOT be taken as legal, business, tax, or investment advice or be used to evaluate any investment or security; and is not directed at any investors or potential investors in any a16z fund. a16z and its affiliates may maintain investments in the companies discussed. For more details please see a16z.com/disclosures.


Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.

Jaksot(81)

AI, Data Engineering, and the Modern Data Stack

AI, Data Engineering, and the Modern Data Stack

In this episode of AI + a16z, dbt Labs founder and CEO Tristan Handy sits down with a16z's Jennifer Li and Matt Bornstein to explore the next chapter of data engineering — from the rise (and plateau) ...

20 Kesä 202535min

Enabling Agents and Battling Bots on an AI-Centric Web

Enabling Agents and Battling Bots on an AI-Centric Web

Arcjet CEO David Mytton sits down with a16z partner Joel de la Garza to discuss the increasing complexity of managing who can access websites, and other web apps, and what they can do there. A primary...

13 Kesä 202526min

Giving New Life to Unstructured Data with LLMs and Agents

Giving New Life to Unstructured Data with LLMs and Agents

Instabase founder and CEO Anant Bhardwaj joins a16z Infra partner Guido Appenzeller to discuss the revolutionary impact of LLMs on analyzing unstructured data and documents (like letting banks verify ...

6 Kesä 202535min

Beyond Leaderboards: LMArena’s Mission to Make AI Reliable

Beyond Leaderboards: LMArena’s Mission to Make AI Reliable

LMArena cofounders Anastasios N. Angelopoulos, Wei-Lin Chiang, and Ion Stoica sit down with a16z general partner Anjney Midha to talk about the future of AI evaluation. As benchmarks struggle to keep ...

30 Touko 20251h 41min

Building AI Systems You Can Trust

Building AI Systems You Can Trust

In this episode of AI + a16z, Distributional cofounder and CEO Scott Clark, and a16z partner Matt Bornstein, explore why building trust in AI systems matters more than just optimizing performance metr...

23 Touko 202547min

Who's Coding Now? AI and the Future of Software Development

Who's Coding Now? AI and the Future of Software Development

In this episode of the a16z AI podcast, a16z Infra partners Guido Appenzeller, Matt Bornstein, and Yoko Li explore how generative AI is reshaping software development. From its potential as a new high...

16 Touko 202544min

MCP Co-Creator on the Next Wave of LLM Innovation

MCP Co-Creator on the Next Wave of LLM Innovation

In this episode of AI + a16z, Anthropic's David Soria Parra — who created MCP (Model Context Protocol) along with Justin Spahr-Summers — sits down with a16z's Yoko Li to discuss the project's inceptio...

2 Touko 202553min

What Is an AI Agent?

What Is an AI Agent?

In this episode of AI + a16z, a16z Infra partners Guido Appenzeller, Matt Bornstein, and Yoko Li discuss and debate one of the tech industry's buzziest words right now: AI agents. The trio digs into t...

28 Huhti 202536min

Suosittua kategoriassa Liike-elämä ja talous

sijotuskasti
psykopodiaa-podcast
mimmit-sijoittaa
rss-rahapodi
rss-rahamania
ostan-asuntoja-podcast
rahapuhetta
inderespodi
rss-h-asselmoilanen
rss-lahtijat
rss-bisnesta-bebeja
herrasmieshakkerit
rss-neuvottelija-sami-miettinen
pomojen-suusta
rss-porssipuhetta
rss-laakispodi
rss-startup-ministerio
rss-paasipodi
sijoituspodi
asuntoasiaa-paivakirjat