Episode 15 - Inside the Model Spec

The more AI can do, the more we need to ask what it should and shouldn’t do. In this episode, OpenAI researcher Jason Wolfe joins host Andrew Mayne to talk about the Model Spec, the public framework that defines intended model behavior. They discuss how the Model Spec works in practice, including how the chain of command handles conflicts between instructions, and how OpenAI evolves it based on feedback, real-world use, and new model capabilities.

Chapters

00:00 Introduction

01:10 What is the Model Spec?

03:55 How does the Model Spec work in practice?

06:26 Transparency: Where to read the Model Spec & give feedback

07:51 How did the Model Spec originate?

10:02 How does the spec translate into model behavior?

11:26 What is the hierarchy / chain of command?

13:35 Handling edge cases like Santa Claus

17:41 How does the Model Spec evolve over time?

19:59 What happens when models disagree with the spec?

22:05 How do smaller models follow the spec?

23:16 Is chain-of-thought useful for alignment?

24:16 Model Spec vs Anthropic’s Constitution

26:28 What surprised you most?

26:56 How do you define the scope of the spec?

27:44 What is the future of the Model Spec?

31:16 How should developers think about the spec?

34:44 Asimov’s laws vs Model Spec

37:16 Could AI write a Human Spec?

Hosted on Acast. See acast.com/privacy for more information.

Denne episoden er hentet fra en åpen RSS-feed og er ikke publisert av Podme. Den kan derfor inneholde annonser.

Episoder(20)

Episode 19 - Inside image generation’s Renaissance moment

People are generating over 1.5 billion images a week in ChatGPT. In this episode, Product lead Adele Li and researcher Kenji Hata share some of the new use cases and trends since the launch of Images ...

14 Mai 29min

Episode 18 - Why AI needs a new kind of supercomputer network

Training frontier models isn’t as simple as adding more GPUs—one small problem and the whole coordinated dance falls apart. OpenAI’s Mark Handley and Greg Steinbrecher discuss how a new supercomputer ...

6 Mai 37min

Episode 17 - What happens now that AI is good at math?

Math is one of the clearest ways to see how far AI has come in a short span. OpenAI researchers Sébastien Bubeck and Ernest Ryu join host Andrew Mayne to explain what changed and what it could mean fo...

28 Apr 43min

Episode 16 - Building AI for Life Sciences

What does it take to build AI systems that can actually help scientists? Research lead Joy Jiao and product lead Yunyun Wang discuss how OpenAI is developing models for life sciences and what responsi...

16 Apr 44min

Episode 14 - Building AI for better healthcare

Healthcare systems around the world are under strain, and both patients and clinicians are feeling the impact. OpenAI's Head of Health Dr. Nate Gross and Karan Singhal, who leads Health AI Research, d...

16 Mar 30min

Episode 13 - The Thinking Behind Ads in ChatGPT

How should advertising work in an AI product? Asad Awan, one of the ad leads at OpenAI, walks through how the company is approaching this decision and why it’s testing ads in ChatGPT at all. He explai...

9 Feb 25min

Episode 12 - State of the AI Industry

OpenAI CFO Sarah Friar and Khosla Ventures founder Vinod Khosla argue the greatest challenges in AI right now are keeping up with demand and making sure more people get the benefit. They unpack what's...

19 Jan 49min