Inferact: Building the Infrastructure That Runs Modern AI
AI + a16z22 Jan

Inferact: Building the Infrastructure That Runs Modern AI

Inferact is a new AI infrastructure company founded by the creators and core maintainers of vLLM. Its mission is to build a universal, open-source inference layer that makes large AI models faster, cheaper, and more reliable to run across any hardware, model architecture, or deployment environment. Together, they broke down how modern AI models are actually run in production, why “inference” has quietly become one of the hardest problems in AI infrastructure, and how the open-source project vLLM emerged to solve it. The conversation also looked at why the vLLM team started Inferact and their vision for a universal inference layer that can run any model, on any chip, efficiently.

Follow Matt Bornstein on X: https://twitter.com/BornsteinMatt

Follow Simon Mo on X: https://twitter.com/simon_mo_

Follow Woosuk Kwon on X: https://twitter.com/woosuk_k

Follow vLLM on X: https://twitter.com/vllm_project

Check out everything a16z is doing with artificial intelligence here, including articles, projects, and more podcasts.

Please note that the content here is for informational purposes only; should NOT be taken as legal, business, tax, or investment advice or be used to evaluate any investment or security; and is not directed at any investors or potential investors in any a16z fund. a16z and its affiliates may maintain investments in the companies discussed. For more details please see a16z.com/disclosures.


Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.

Episoder(81)

Fei-Fei Li: World Models and the Multiverse

Fei-Fei Li: World Models and the Multiverse

What if the next leap in artificial intelligence isn’t about better language—but better understanding of space?In this episode, a16z General Partner Erik Torenberg moderates a conversation with Fei-Fe...

23 Des 202522min

Building the “See Something, Say Something” AI for Every Camera

Building the “See Something, Say Something” AI for Every Camera

a16z's Martin Casado sits down with Shikhar Shrestha, CEO and cofounder of Ambient, the company bringing agentic AI to physical security.Shikhar shares how a traumatic armed robbery at age 12—and a se...

16 Des 202539min

The AI That Found A Bug In The World’s Most Audited Code

The AI That Found A Bug In The World’s Most Audited Code

Matt Knight spent five years as OpenAI’s CISO. Now he runs what colleagues call “the most interesting job at the company”: leading Aardvark, an AI agent that finds security vulnerabilities the way a h...

10 Des 202539min

The Death of Data Gatekeeping: AI Makes Everyone An Analyst | Hex Cofounder

The Death of Data Gatekeeping: AI Makes Everyone An Analyst | Hex Cofounder

Most companies still rely on dashboards to understand their data, even though AI now offers new ways to ask questions and explore information. Barry McCardel, CEO of Hex and former engineer at Palanti...

5 Des 20251h 22min

Why Social Engineering Now Works on Machines

Why Social Engineering Now Works on Machines

Ian Webster built PromptFoo after watching 200 million Discord users systematically dismantle his AI agent—now Fortune 10 companies pay him to break theirs before customers do. The "lethal trifecta" s...

2 Des 202525min

“Anyone Can Code Now” - Netlify CEO Talks AI Agents

“Anyone Can Code Now” - Netlify CEO Talks AI Agents

Netlify's CEO, Matt Biilmann, reveals a seismic shift nobody saw coming: 16,000 daily signups—five times last year's rate—and 96% aren't coming from AI coding tools. They're everyday people accidental...

28 Nov 202557min

From Code Search to AI Agents: Inside Sourcegraph's Transformation with CTO Beyang Liu

From Code Search to AI Agents: Inside Sourcegraph's Transformation with CTO Beyang Liu

Sourcegraph's CTO just revealed why 90% of his code now comes from agents—and why the Chinese models powering America's AI future should terrify Washington. While Silicon Valley obsesses over AGI apoc...

25 Nov 202546min

Ryo Lu (Cursor): AI Turns Designers to Developers

Ryo Lu (Cursor): AI Turns Designers to Developers

Ryo Lu spent years watching his designs die in meetings. Then he discovered the tool that lets designers ship code at the speed of thought: Cursor, the company where Ryo is now Head of Design. In this...

21 Nov 202552min

Populært innen Business og økonomi

stopp-verden
dine-penger-pengeradet
e24-podden
rss-penger-polser-og-politikk
rss-borsmorgen-okonominyhetene
pengepodden-2
pengesnakk
utbytte
finansredaksjonen
morgenkaffen-med-finansavisen
tid-er-penger-en-podcast-med-peter-warren
livet-pa-veien-med-jan-erik-larssen
rss-sunn-okonomi
lederpodden
rss-markedspuls-2
okonomiamatorene
rss-fa-makro
lydartikler-fra-aftenposten
boligbobla
rss-andelige-tanker-med-camillo