Inferact: Building the Infrastructure That Runs Modern AI
AI + a16z22 Tammi

Inferact: Building the Infrastructure That Runs Modern AI

Inferact is a new AI infrastructure company founded by the creators and core maintainers of vLLM. Its mission is to build a universal, open-source inference layer that makes large AI models faster, cheaper, and more reliable to run across any hardware, model architecture, or deployment environment. Together, they broke down how modern AI models are actually run in production, why “inference” has quietly become one of the hardest problems in AI infrastructure, and how the open-source project vLLM emerged to solve it. The conversation also looked at why the vLLM team started Inferact and their vision for a universal inference layer that can run any model, on any chip, efficiently.

Follow Matt Bornstein on X: https://twitter.com/BornsteinMatt

Follow Simon Mo on X: https://twitter.com/simon_mo_

Follow Woosuk Kwon on X: https://twitter.com/woosuk_k

Follow vLLM on X: https://twitter.com/vllm_project

Check out everything a16z is doing with artificial intelligence here, including articles, projects, and more podcasts.

Please note that the content here is for informational purposes only; should NOT be taken as legal, business, tax, or investment advice or be used to evaluate any investment or security; and is not directed at any investors or potential investors in any a16z fund. a16z and its affiliates may maintain investments in the companies discussed. For more details please see a16z.com/disclosures.


Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.

Jaksot(84)

Building Developers Tools, From Docker to Diffusion Models

Building Developers Tools, From Docker to Diffusion Models

In this episode of AI + a16z, Replicate cofounder and CEO Ben Firshman, and a16z partner Matt Bornstein, discuss the art of building products and companies that appeal to software developers. Ben was ...

15 Marras 202441min

The Best Way to Achieve AGI Is to Invent It

The Best Way to Achieve AGI Is to Invent It

Longtime machine-learning researcher, and University of Washington Professor Emeritus, Pedro Domingos joins a16z General Partner Martin Casado to discuss the state of artificial intelligence, whether ...

4 Marras 202438min

Neural Nets and Nobel Prizes: AI's 40-Year Journey from the Lab to Ubiquity

Neural Nets and Nobel Prizes: AI's 40-Year Journey from the Lab to Ubiquity

In this episode of AI + a16z, General Partner Anjney Midha shares his perspective on the recent collection of Nobel Prizes awarded to AI researchers in both Physics and Chemistry. He talks through how...

25 Loka 202440min

How GPU Access Helps AI Startups Be Agile

How GPU Access Helps AI Startups Be Agile

In this episode of AI + a16z, General Partner Anjney Midha explains the forces that lead to GPU shortages and price spikes, and how the firm mitigates these concerns for portfolio companies by supplyi...

23 Loka 202439min

DisTrO and the Quest for Community-Trained AI Models

DisTrO and the Quest for Community-Trained AI Models

In this episode of AI + a16z, Bowen Peng and Jeffrey Quesnelle of Nous Research join a16z General Partner Anjney Midha to discuss their mission to keep open source AI research alive and activate the c...

27 Syys 20241h 12min

Balancing AI Expertise and Industry Acumen in Vertical Applications

Balancing AI Expertise and Industry Acumen in Vertical Applications

In this episode of AI + a16z, Ambience cofounder and chief scientist Nikhil Buduma joins Derrick Harris to discuss the nuances of using AI models to build vertical applications (including in his space...

13 Syys 202442min

AI, SQL, and the End of Big Data

AI, SQL, and the End of Big Data

In this episode of AI + a16z, a16z General Partner Jennifer Li joins MotherDuck Cofounder and CEO Jordan Tigani to discuss DuckDB's spiking popularity as the era of big data wanes, as well as the appl...

30 Elo 202433min

The Researcher to Founder Journey, and the Power of Open Models

The Researcher to Founder Journey, and the Power of Open Models

In this episode of the AI + a16z podcast, Black Forest Labs founders Robin Rombach, Andreas Blattmann, and Patrick Esser sit down with a16z general partner Anjney Midha to discuss their journey from P...

16 Elo 202437min

Suosittua kategoriassa Liike-elämä ja talous

sijotuskasti
mimmit-sijoittaa
psykopodiaa-podcast
rss-rahapodi
ostan-asuntoja-podcast
pomojen-suusta
rss-rahamania
rss-draivi
inderespodi
rss-seuraava-potilas
rss-sami-miettinen-neuvottelija
rss-myyntikoulu
rss-paasipodi
rahapuhetta
salkunrakentaja-podi
kasvun-kipuja
lakicast
rss-lahtijat
rss-bisnesta-bebeja
rss-asuntosalkku-kasvussa-podcast