80,000 Hours Podcast10 Feb 2025

AGI disagreements and misconceptions: Rob, Luisa, & past guests hash it out

Will LLMs soon be made into autonomous agents? Will they lead to job losses? Is AI misinformation overblown? Will it prove easy or hard to create AGI? And how likely is it that it will feel like something to be a superhuman AGI?

With AGI back in the headlines, we bring you 15 opinionated highlights from the show addressing those and other questions, intermixed with opinions from hosts Luisa Rodriguez and Rob Wiblin recorded back in 2023.

Check out the full transcript on the 80,000 Hours website.

You can decide whether the views we expressed (and those from guests) then have held up these last two busy years. You’ll hear:

Ajeya Cotra on overrated AGI worries
Holden Karnofsky on the dangers of aligned AI, why unaligned AI might not kill us, and the power that comes from just making models bigger
Ian Morris on why the future must be radically different from the present
Nick Joseph on whether his companies internal safety policies are enough
Richard Ngo on what everyone gets wrong about how ML models work
Tom Davidson on why he believes crazy-sounding explosive growth stories… and Michael Webb on why he doesn’t
Carl Shulman on why you’ll prefer robot nannies over human ones
Zvi Mowshowitz on why he’s against working at AI companies except in some safety roles
Hugo Mercier on why even superhuman AGI won’t be that persuasive
Rob Long on the case for and against digital sentience
Anil Seth on why he thinks consciousness is probably biological
Lewis Bollard on whether AI advances will help or hurt nonhuman animals
Rohin Shah on whether humanity’s work ends at the point it creates AGI

And of course, Rob and Luisa also regularly chime in on what they agree and disagree with.

Chapters:

Cold open (00:00:00)
Rob's intro (00:00:58)
Rob & Luisa: Bowerbirds compiling the AI story (00:03:28)
Ajeya Cotra on the misalignment stories she doesn’t buy (00:09:16)
Rob & Luisa: Agentic AI and designing machine people (00:24:06)
Holden Karnofsky on the dangers of even aligned AI, and how we probably won’t all die from misaligned AI (00:39:20)
Ian Morris on why we won’t end up living like The Jetsons (00:47:03)
Rob & Luisa: It’s not hard for nonexperts to understand we’re playing with fire here (00:52:21)
Nick Joseph on whether AI companies’ internal safety policies will be enough (00:55:43)
Richard Ngo on the most important misconception in how ML models work (01:03:10)
Rob & Luisa: Issues Rob is less worried about now (01:07:22)
Tom Davidson on why he buys the explosive economic growth story, despite it sounding totally crazy (01:14:08)
Michael Webb on why he’s sceptical about explosive economic growth (01:20:50)
Carl Shulman on why people will prefer robot nannies over humans (01:28:25)
Rob & Luisa: Should we expect AI-related job loss? (01:36:19)
Zvi Mowshowitz on why he thinks it’s a bad idea to work on improving capabilities at cutting-edge AI companies (01:40:06)
Holden Karnofsky on the power that comes from just making models bigger (01:45:21)
Rob & Luisa: Are risks of AI-related misinformation overblown? (01:49:49)
Hugo Mercier on how AI won’t cause misinformation pandemonium (01:58:29)
Rob & Luisa: How hard will it actually be to create intelligence? (02:09:08)
Robert Long on whether digital sentience is possible (02:15:09)
Anil Seth on why he believes in the biological basis of consciousness (02:27:21)
Lewis Bollard on whether AI will be good or bad for animal welfare (02:40:52)
Rob & Luisa: The most interesting new argument Rob’s heard this year (02:50:37)
Rohin Shah on whether AGI will be the last thing humanity ever does (02:57:35)
Rob's outro (03:11:02)

Audio engineering: Ben Cordell, Milo McGuire, Simon Monsour, and Dominic Armstrong
Transcriptions and additional content editing: Katy Moore

Denne episoden er hentet fra en åpen RSS-feed og er ikke publisert av Podme. Den kan derfor inneholde annonser.

Episoder(340)

We can guess what intergalactic war would look like. And strangely, it matters.

Intergalactic war is probably billions of years away — yet physics can already tell us how it ends. And strangely that conclusion is relevant to decisions people have to make today.In this video, Rob ...

18 Jun 15min

How AI could create the world’s biggest problems (article by Zershaaneh Qureshi)

Imagine you’re living 15,000 years ago. Your people are hunter-gatherers and you sleep under the stars. If someone told you humans would one day build cities with millions of people, fly through the a...

11 Jun 1h 29min

What it's really like to run AGI safety at Google DeepMind (and where I disagree with 'doomers') | Rohin Shah

Most people working on AI safety think without a massive effort AI systems will probably end up with goals catastrophically different from humanity’s. Today’s guest, Rohin Shah — head of AGI Safety an...

2 Jun 2h 48min

What makes for a dream job? | Benjamin Todd

What actually makes a job fulfilling? It's not what most career advice tells you. "Follow your passion" sounds inspiring, but it's misleading — and the research backs that up.Drawing on hundreds of st...

28 Mai 28min

We’re updating our career advice for the strangest time in history | Benjamin Todd, author of 80,000 Hours

The average career is 80,000 hours long. With AI advancing so rapidly, the hours you have left in your career matter more than ever.Some leading AI researchers think there’s a 10% chance that AI syste...

26 Mai 1h 6min

Can AIs already start 'rogue deployments' inside AI companies? (Landmark new METR report)

A red-teamer was embedded inside Anthropic for three weeks, told to imagine he was an evil Claude, and asked to figure out how to launch a ‘rogue AI deployment’ without getting caught. It’s one part o...

20 Mai 20min

#243 – 'Godfather of AI' Yoshua Bengio: "I now see a path" to safe superintelligent AI

The co-inventor of modern AI and the most cited living scientist believes he's figured out how to ensure AI is honest, incapable of deception, and never goes rogue. Yoshua Bengio – Turing Award Winner...

7 Mai 2h 35min

'95% of AI Pilots Fail': The hidden agenda behind the viral stat that misled millions

You might have heard that '95% of corporate AI pilots' are failing. It was one of the most widely cited AI statistics of 2025, parroted by media outlets everywhere. It helped trigger a Nasdaq selloff ...

28 Apr 10min