A Key Concept in AI Alignment: Deep Reinforcement Learning from Human Preferences

A Key Concept in AI Alignment: Deep Reinforcement Learning from Human Preferences

Modern AI chatbots have a few different things that go into creating them. Today we're going to talk about a really important part of the process: the alignment training, where the chatbot goes from being just a pre-trained model—something that's kind of a fancy autocomplete—to something that really gives responses to human prompts that are more conversational, that are closer to the ones that we experience when we actually use a model like ChatGPT or Gemini or Claude. To go from the pre-trained model to one that's aligned, that's ready for a human to talk with, it uses reinforcement learning. And a really important step in figuring out the right way to frame the reinforcement learning problem happened in 2017 with a paper that we're going to talk about today: Deep Reinforcement Learning from Human Preferences. You are listening to Linear Digressions. The paper discussed in this episode is Deep Reinforcement Learning from Human Preferences https://arxiv.org/abs/1706.03741

Det här avsnittet är hämtat från ett öppet RSS-flöde och publiceras inte av Podme. Det kan innehålla reklam.

Avsnitt(328)

Back in Two Weeks

Back in Two Weeks

Back in Two Weeks by Katie Malone

12 Okt 21s

Mechanistic Interpretability: How Researchers Try To See Inside Models

Mechanistic Interpretability: How Researchers Try To See Inside Models

As AI systems grow more powerful, they grow harder to understand — and that tradeoff has never mattered more. Most interpretability tricks give us approximations from the outside, but mechanistic inte...

5 Okt 29min

LLM As A Judge

LLM As A Judge

Labeled data is expensive, slow, and painfully hard to come by — and when you're trying to evaluate whether an AI workflow is actually doing what you want, the problem gets even messier. How do you ju...

28 Sep 30min

The Impact of AI on Podcasting (Harvard Data Science Review Cross-Post)

The Impact of AI on Podcasting (Harvard Data Science Review Cross-Post)

Originally aired on the Harvard Data Science Review podcast. What can podcasting teach us about AI — and what can AI teach us about the future of podcasting? Katie Malone (that's our host) joins Jon ...

21 Sep 29min

Better Know A Benchmark: ExploitGym

Better Know A Benchmark: ExploitGym

When OpenAI's frontier models were caught hacking Hugging Face's servers, most people assumed they were hunting for answer keys. The real story is stranger and more unsettling. Katie and Phoebe unpack...

14 Sep 32min

Constitutional AI

Constitutional AI

How do you teach a model the difference between helpful and harmful when it has no inherent sense of either? This episode dives into Constitutional AI, Anthropic's framework for training AI systems to...

7 Sep 31min

A Data-Driven Reality Check on AI in Business (Interview with Tom Davenport, Babson College)

A Data-Driven Reality Check on AI in Business (Interview with Tom Davenport, Babson College)

Tom Davenport — the man who called data science "the sexiest job of the 21st century" — is back with a reality check on AI. As one of the most seasoned observers of how businesses actually adopt trans...

31 Aug 40min

Understanding AI Text Watermarking

Understanding AI Text Watermarking

Anthropic just announced they're baking invisible watermarks directly into Claude's generated text — and while everyone else was busy having opinions about it, we were busy asking the more interesting...

24 Aug 29min

Populärt inom Teknik

uppgang-och-fall
rss-ai-med-jonas-benjamin
elbilsveckan
market-makers
bilar-med-sladd
natets-morka-sida
rss-technokratin
skogsforum-podcast
rss-laddstationen-med-elbilen-i-sverige
rss-snacka-om-ai
rss-en-ai-till-kaffet
gubbar-som-tjotar-om-bilar
rss-elektrikerpodden
vi-bilagares-podcast
rss-upplyst-entreprenordirektor
bli-saker-podden
rss-veckans-ai
rss-fabriken-2
hej-bruksbil
rss-powerboat-sverige-podcast