Better Know a Benchmark: Humanity's Last Exam
Humanity's Last Exam was designed with a bold premise: questions that human experts can answer, but AI models can't. Originally dubbed "Humanity's Last Stand," this benchmark is a massive academic col...
17 Aug 23min
A Scientific Deep Dive into Overconfident LLMs: Interview with Kaitlyn Zhou (Cornell)
When a language model tells you it's absolutely certain, is it actually more likely to be right? Kaitlyn Zhou's research says: not necessarily — sometimes confident phrasing correlates with *worse* ac...
10 Aug 33min
Reasoning Models: When LLMs Went Beyond Fancy Autocomplete
Reasoning models don't just answer your question — they *think out loud* first. In this episode we dig into the class of AI models that generate intermediate chains of thought before arriving at a fin...
3 Aug 25min
Distillation, or, How to Steal a Model
This week we’re covering model distillation: the technique of using a large "teacher" model's outputs to train a smaller, cheaper "student" model that mimics it. They cover the two big reasons labs do...
27 Jul 23min
Invisible LLM Failures and AI Fluency with Chris Potts (Stanford)
What happens when a Stanford linguistics professor turns his attention to AI chatbots — and the surprisingly invisible ways humans misunderstand them? Chris Potts joins the show to unpack the hidden f...
20 Jul 41min
Still summer break: back next week
Still summer break: back next week by Katie Malone
13 Jul 25s
Summer break: back soon
Summer break: back soon by Katie Malone
6 Jul 36s
