High Signal: Data Science | Career | AI5 Mars

Episode 35: Beyond Online Experimentation: Generative Software That Optimizes Itself

Martin Tingley, Head of Windows Experimentation at Microsoft and former Head of the Experimentation Platform Analysis Team at Netflix, talks about why humans are the bottleneck in experimentation, and how a five-level maturity framework points the way toward self-optimizing software.

Our conversation traces the path from basic hypothesis testing to a frontier where Generative AI creates, evaluates, and refines product variants in a closed loop. We explore the architectural shift required to move from testing single variants to optimizing entire parameter spaces, and how startups are already using AI to generate production-ready landing pages for Fortune 500 companies in hours rather than weeks. Tingley also shares a strategic lens on "experimentation programs," explaining how plotting the distribution of treatment effects across different product areas can serve as a powerful tool for capital allocation and high-level strategy.

LINKS

Det här avsnittet är hämtat från ett öppet RSS-flöde och publiceras inte av Podme. Det kan innehålla reklam.

Avsnitt(41)

Episode 41: The Verification Crisis: Why Trust Is the New Bottleneck in AI

Noah Smith, economist and author of Noahpinion, joins High Signal to look at what AI is already changing… and what it isn’t. The conversation moves beyond the usual productivity hype to ask harder que...

18 Juni 53min

Episode 40: The Economic Reality of AI: Friction, Talent, and the Future of the Firm

Steve Tadelis, Professor of Economics at UC Berkeley and former senior economist at eBay and Amazon, joins High Signal to bridge the gap between economic theory and the high-stakes reality of data sci...

26 Maj 58min

Episode 39: The 100-Year Lead: What Baseball Teaches Us About the Future of AI

Chris Fonnesbeck, veteran analyst for the Yankees and Mets and creator of the open-source Bayesian modeling library PyMC, joins to unpack why baseball has been a leading indicator for data science and...

12 Maj 56min

Episode 38: Why AI Won’t Fix Your Data Culture, It Will Only Amplify It (And What To Do About It)

Noah Bruegmann, President of Data CRT, joins High Signal to discuss how to move your data function from a cost center to a strategic "value center". He explains how AI amplifies your existing data cul...

16 Apr 45min

Episode 37: Engineered Intelligence and The Data Science Problem in AI

Jordan Morrow, SVP of Data & AI Transformation at AgileOne and the "Godfather of Data Literacy," joins High Signal to discuss the shift from being "data-driven" to becoming "AI-enabled." Jordan warns ...

2 Apr 46min

Episode 36: AI and the Judgment Problem in Data Science

Dawn Woodard (Distinguished Engineer, LinkedIn), Andrés Bucchi (LATAM Airlines), and Jeremy Hermann (CEO & Co-Founder, Delphina) join High Signal for a deep dive into the shifting architecture of data...

19 Mars 1h 3min

Episode 34: Duolingo and the Future of Personalized Education with AI

Bozena Pajak, VP of Learning at Duolingo, joins High Signal to discuss the evolution of AI at Duolingo: from personalized difficulty models to the current generative frontier where AI characters provi...

10 Feb 45min