Building AI Systems You Can Trust
AI + a16z23 Mai 2025

Building AI Systems You Can Trust

In this episode of AI + a16z, Distributional cofounder and CEO Scott Clark, and a16z partner Matt Bornstein, explore why building trust in AI systems matters more than just optimizing performance metrics. From understanding the hidden complexities of generative AI behavior to addressing the challenges of reliability and consistency, they discuss how to confidently deploy AI in production.

Why is trust becoming a critical factor in enterprise AI adoption? How do traditional performance metrics fail to capture crucial behavioral nuances in generative AI systems? Scott and Matt dive into these questions, examining non-deterministic outcomes, shifting model behaviors, and the growing importance of robust testing frameworks.

Among other topics, they cover:

  • The limitations of conventional AI evaluation methods and the need for behavioral testing.
  • How centralized AI platforms help enterprises manage complexity and ensure responsible AI use.
  • The rise of "shadow AI" and its implications for security and compliance.
  • Practical strategies for scaling AI confidently from prototypes to real-world applications.

Follow everyone:

Scott Clark

Distributional

Matt Bornstein

Derrick Harris

Check out everything a16z is doing with artificial intelligence here, including articles, projects, and more podcasts.

Please note that the content here is for informational purposes only; should NOT be taken as legal, business, tax, or investment advice or be used to evaluate any investment or security; and is not directed at any investors or potential investors in any a16z fund. a16z and its affiliates may maintain investments in the companies discussed. For more details please see a16z.com/disclosures.


Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.

Episoder(82)

Feed Drop from The Generalist: Why a16z's Martin Casado believes the AI boom still has years to run

Feed Drop from The Generalist: Why a16z's Martin Casado believes the AI boom still has years to run

This episode is a special replay from The Generalist Podcast, featuring a conversation with a16z General Partner Martin Casado. Martin has lived through multiple tech waves as a founder, researcher, a...

30 Des 20251h 21min

Fei-Fei Li: World Models and the Multiverse

Fei-Fei Li: World Models and the Multiverse

What if the next leap in artificial intelligence isn’t about better language—but better understanding of space?In this episode, a16z General Partner Erik Torenberg moderates a conversation with Fei-Fe...

23 Des 202522min

Building the “See Something, Say Something” AI for Every Camera

Building the “See Something, Say Something” AI for Every Camera

a16z's Martin Casado sits down with Shikhar Shrestha, CEO and cofounder of Ambient, the company bringing agentic AI to physical security.Shikhar shares how a traumatic armed robbery at age 12—and a se...

16 Des 202539min

The AI That Found A Bug In The World’s Most Audited Code

The AI That Found A Bug In The World’s Most Audited Code

Matt Knight spent five years as OpenAI’s CISO. Now he runs what colleagues call “the most interesting job at the company”: leading Aardvark, an AI agent that finds security vulnerabilities the way a h...

10 Des 202539min

The Death of Data Gatekeeping: AI Makes Everyone An Analyst | Hex Cofounder

The Death of Data Gatekeeping: AI Makes Everyone An Analyst | Hex Cofounder

Most companies still rely on dashboards to understand their data, even though AI now offers new ways to ask questions and explore information. Barry McCardel, CEO of Hex and former engineer at Palanti...

5 Des 20251h 22min

Why Social Engineering Now Works on Machines

Why Social Engineering Now Works on Machines

Ian Webster built PromptFoo after watching 200 million Discord users systematically dismantle his AI agent—now Fortune 10 companies pay him to break theirs before customers do. The "lethal trifecta" s...

2 Des 202525min

“Anyone Can Code Now” - Netlify CEO Talks AI Agents

“Anyone Can Code Now” - Netlify CEO Talks AI Agents

Netlify's CEO, Matt Biilmann, reveals a seismic shift nobody saw coming: 16,000 daily signups—five times last year's rate—and 96% aren't coming from AI coding tools. They're everyday people accidental...

28 Nov 202557min

From Code Search to AI Agents: Inside Sourcegraph's Transformation with CTO Beyang Liu

From Code Search to AI Agents: Inside Sourcegraph's Transformation with CTO Beyang Liu

Sourcegraph's CTO just revealed why 90% of his code now comes from agents—and why the Chinese models powering America's AI future should terrify Washington. While Silicon Valley obsesses over AGI apoc...

25 Nov 202546min

Populært innen Business og økonomi

stopp-verden
lydartikler-fra-aftenposten
dine-penger-pengeradet
e24-podden
rss-penger-polser-og-politikk
rss-borsmorgen-okonominyhetene
finansredaksjonen
pengepodden-2
pengesnakk
tid-er-penger-en-podcast-med-peter-warren
livet-pa-veien-med-jan-erik-larssen
rss-sunn-okonomi
utbytte
stormkast-med-valebrokk-stordalen
morgenkaffen-med-finansavisen
lederpodden
okonomiamatorene
rss-markedspuls-2
rss-fa-makro
flypodden