Inferact: Building the Infrastructure That Runs Modern AI
AI + a16z22 Tammi

Inferact: Building the Infrastructure That Runs Modern AI

Inferact is a new AI infrastructure company founded by the creators and core maintainers of vLLM. Its mission is to build a universal, open-source inference layer that makes large AI models faster, cheaper, and more reliable to run across any hardware, model architecture, or deployment environment. Together, they broke down how modern AI models are actually run in production, why “inference” has quietly become one of the hardest problems in AI infrastructure, and how the open-source project vLLM emerged to solve it. The conversation also looked at why the vLLM team started Inferact and their vision for a universal inference layer that can run any model, on any chip, efficiently.

Follow Matt Bornstein on X: https://twitter.com/BornsteinMatt

Follow Simon Mo on X: https://twitter.com/simon_mo_

Follow Woosuk Kwon on X: https://twitter.com/woosuk_k

Follow vLLM on X: https://twitter.com/vllm_project

Check out everything a16z is doing with artificial intelligence here, including articles, projects, and more podcasts.

Please note that the content here is for informational purposes only; should NOT be taken as legal, business, tax, or investment advice or be used to evaluate any investment or security; and is not directed at any investors or potential investors in any a16z fund. a16z and its affiliates may maintain investments in the companies discussed. For more details please see a16z.com/disclosures.


Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.

Jaksot(84)

What DeepSeek Means for Cybersecurity

What DeepSeek Means for Cybersecurity

In this episode of AI + a16z, a trio of security experts join a16z partner Joel de la Garza to discuss the security implications of the DeepSeek reasoning model that made waves recently. It's three se...

28 Helmi 202552min

Agents, Lawyers, and LLMs

Agents, Lawyers, and LLMs

In this episode of AI + a16z, Aatish Nayak, head of product at Harvey, sits down with a16z partner Kimberly Tan to share his experience building AI products for enterprises — including the legal profe...

21 Helmi 202540min

Reasoning Models Are Remaking Professional Services

Reasoning Models Are Remaking Professional Services

In this episode of AI + a16z, a16z partner Alex Immerman sits down with Hebbia founder and CEO George Sivulka to discuss the potential for reasoning models and AI agents to supercharge knowledge-worke...

14 Helmi 202537min

Data Management for Enterprise LLMs

Data Management for Enterprise LLMs

In this episode of AI + a16z, Fivetran cofounder and CEO George Fraser and a16z partner Guido Appenzeller discuss how LLMs fit into the data management picture within large enterprises. In order to ta...

7 Helmi 202538min

From NLP to LLMs: The Quest for a Reliable Chatbot

From NLP to LLMs: The Quest for a Reliable Chatbot

In this episode of AI + a16z, a16z General Partner Martin Casado and Rasa cofounder and CEO Alan Nichol discuss the past, present, and future of AI agents and chatbots. Alan shares his history working...

10 Tammi 202538min

Best of the Year: Building AI Companies

Best of the Year: Building AI Companies

A 2024 highlight reel, featuring founders sharing their insights, advice, and experiences building AI companies — from foundation-model labs to vertical applications. Topics include:Building AI tools ...

27 Joulu 202446min

Can AI Agents Finally Fix Customer Support?

Can AI Agents Finally Fix Customer Support?

In this episode of the AI + a16z podcast, Decagon cofounder/CEO Jesse Zhang and a16z partner Kimberly Tan discuss how LLMs are reshaping customer support, the strong market demand for AI agents, and h...

18 Joulu 202444min

REPLAY: Scoping the Enterprise LLM Market

REPLAY: Scoping the Enterprise LLM Market

This is a replay of our first episode from April 12, featuring Databricks VP of AI Naveen Rao and a16z partner Matt Bornstein discussing enterprise LLM adoption, hardware platforms, and what it means ...

30 Marras 202443min

Suosittua kategoriassa Liike-elämä ja talous

sijotuskasti
mimmit-sijoittaa
psykopodiaa-podcast
rss-rahapodi
rss-draivi
rss-rahamania
ostan-asuntoja-podcast
rss-sami-miettinen-neuvottelija
pomojen-suusta
inderespodi
rss-seuraava-potilas
herrasmieshakkerit
taloudellinen-mielenrauha
oppimisen-psykologia
rss-h-asselmoilanen
rss-paasipodi
rss-inderes
asuntoasiaa-paivakirjat
rss-lahtijat
rss-bisnesta-bebeja