Inferact: Building the Infrastructure That Runs Modern AI
AI + a16z22 Tammi

Inferact: Building the Infrastructure That Runs Modern AI

Inferact is a new AI infrastructure company founded by the creators and core maintainers of vLLM. Its mission is to build a universal, open-source inference layer that makes large AI models faster, cheaper, and more reliable to run across any hardware, model architecture, or deployment environment. Together, they broke down how modern AI models are actually run in production, why “inference” has quietly become one of the hardest problems in AI infrastructure, and how the open-source project vLLM emerged to solve it. The conversation also looked at why the vLLM team started Inferact and their vision for a universal inference layer that can run any model, on any chip, efficiently.

Follow Matt Bornstein on X: https://twitter.com/BornsteinMatt

Follow Simon Mo on X: https://twitter.com/simon_mo_

Follow Woosuk Kwon on X: https://twitter.com/woosuk_k

Follow vLLM on X: https://twitter.com/vllm_project

Check out everything a16z is doing with artificial intelligence here, including articles, projects, and more podcasts.

Please note that the content here is for informational purposes only; should NOT be taken as legal, business, tax, or investment advice or be used to evaluate any investment or security; and is not directed at any investors or potential investors in any a16z fund. a16z and its affiliates may maintain investments in the companies discussed. For more details please see a16z.com/disclosures.


Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.

Jaksot(81)

How Foundation Models Evolved: A PhD Journey Through AI's Breakthrough Era

How Foundation Models Evolved: A PhD Journey Through AI's Breakthrough Era

The Stanford PhD who built DSPy thought he was just creating better prompts—until he realized he'd accidentally invented a new paradigm that makes LLMs actually programmable. While everyone obsesses o...

18 Marras 202557min

TruffleHog Creator: You Can’t Have AI Agents Without Secrets

TruffleHog Creator: You Can’t Have AI Agents Without Secrets

If you can’t robustly protect your secrets, you can’t have reliable AI agents.In this episode, Truffle Security cofounder and CEO Dylan Ayrey joins a16z partner Joel de la Garza to discuss the emergen...

11 Marras 202528min

Tigris Data CEO on Building Your Own Datacenters

Tigris Data CEO on Building Your Own Datacenters

In this episode, a16z General Partner Martin Casado sits down with Ovais Tariq, Cofounder and CEO of Tigris Data, to discuss why independent storage is so hard, what operating your own datacenters is ...

7 Marras 202538min

Pylon: Reimagining B2B Customer Support

Pylon: Reimagining B2B Customer Support

Customer support platforms lacked adequate solutions for B2B companies - until Pylon entered the scene.We sat down with Pylon cofounders Marty Kausas, Advith Chelikani, and Robert Eng to discuss why t...

31 Loka 202547min

Keycard: 2026 is the Year of Agents

Keycard: 2026 is the Year of Agents

In 2025, we saw the first glimpses of true AI agents. In 2026, every company will be rushing to get them into production, and they’ll need companies like Keycard to manage fleets of agents.In this con...

22 Loka 202532min

The Trillion Dollar AI Software Development Stack

The Trillion Dollar AI Software Development Stack

AI coding has emerged as a major market for AI: one that’s already rewriting how software gets built.a16z Infra Partners Yoko Li and Guido Appenzeller break down how “agents with environments” are cha...

10 Loka 202538min

Material Security CEO: How To Find Your Ideal Customer

Material Security CEO: How To Find Your Ideal Customer

What if the hardest part of building a company isn’t the product, but knowing exactly who it’s for?In this episode, a16z General Partner Martin Casado sits down with Abhishek Agrawal, Cofounder and CE...

6 Loka 202534min

When Deepfakes Steal $30M: The New Edge of Cybercrime

When Deepfakes Steal $30M: The New Edge of Cybercrime

AI is transforming both sides of the cybersecurity cat-and-mouse game. Attackers are using LLMs to scale impersonation, phishing, and even deepfake fraud—while defenders are racing to automate detecti...

26 Syys 202522min

Suosittua kategoriassa Liike-elämä ja talous

sijotuskasti
psykopodiaa-podcast
mimmit-sijoittaa
rss-rahapodi
rss-rahamania
ostan-asuntoja-podcast
rahapuhetta
inderespodi
rss-h-asselmoilanen
rss-lahtijat
rss-bisnesta-bebeja
herrasmieshakkerit
rss-neuvottelija-sami-miettinen
pomojen-suusta
rss-porssipuhetta
rss-laakispodi
rss-startup-ministerio
rss-paasipodi
sijoituspodi
asuntoasiaa-paivakirjat