#253 – AI 2027's author returns with a plan to change the ending | Daniel Kokotajlo

#253 – AI 2027's author returns with a plan to change the ending | Daniel Kokotajlo

Last year, Daniel Kokotajlo and his colleagues published AI 2027 — a scenario read by millions, including US Vice President Vance. AI 2027 ended in human extinction or an irreversible concentration of power caused by superintelligent AI. Now his team has published what they think should happen instead.

AI 2040: Plan A depicts the US and China striking a verified deal to ban runaway intelligence explosions, so that superintelligence arrives in 2040 — after a cautious decade spent solving alignment, spreading the technology’s power widely, and keeping the whole thing reversible — rather than in the next few years.

This slowdown would still involve economic growth roughly doubling every year, and only 8% of Americans in paid work by the mid-2030s. In other words, it’s a slowdown that would feel faster than any period in human history — bewildering, materially abundant, and socially chaotic all at once.

Daniel and host Luisa Rodriguez dig into what it would take to enact this vision for the future, how the US and China could come to an agreement to slow down AI development, and the likeliest alternatives to Plan A — both good and disastrous.

Learn more, video, and full transcript: https://80k.info/dk26

This episode was recorded July 27–28, 2026.

Chapters:

  • Who’s Daniel Kokotajlo? (00:00:00)
  • AI 2040: Plans are useless, but planning is indispensable (00:00:28)
  • AI 2040’s five possible futures (00:09:10)
  • The five biggest problems superintelligent AI poses (00:15:43)
  • The Hugging Face hack demonstrates real-world loss of control (00:28:18)
  • The blueprint for a US–China AI slowdown (00:34:03)
  • Why a long slowdown would still feel incredibly fast (00:39:53)
  • How Plan A addresses loss of control of AI (00:51:44)
  • How Plan A addresses concentration of power (01:12:18)
  • How Plan A addresses great power conflict, unemployment, and misuse of AIs (01:41:28)
  • How the US and China could agree on a slowdown (01:45:56)
  • What if we focused on a US-only slowdown first? (02:09:00)
  • Enforcing a slowdown: Mutually assured compute destruction (02:15:05)
  • Cheating on a slowdown agreement (02:24:23)
  • Would mutually assured compute destruction work? (02:30:42)
  • Is slowing down or shutting down better? (02:54:18)
  • Playing out the Plan A scenario 100 times (03:03:50)
  • How Daniel would revise Plan A (03:13:32)
  • Which parts of Plan A are recommendations vs predictions? (03:23:02)
  • Plan A’s likeliest failure mode (03:26:52)
  • What the US can do now to make Plan A possible (03:31:16)
  • How AI 2027 is holding up (03:43:05)
  • Our podcast team is hiring (03:46:45)

Our production team includes:

  • Video editors: Josh Alward, Dominic Armstrong, Ollie Bignell, Andrés Escobar, Milo McGuire, Luke Monsour, and Simon Monsour
  • Producers: Elizabeth Cox and Nick Stockton
  • Coordination and support: Katy Moore and Lou Moran

Det här avsnittet är hämtat från ett öppet RSS-flöde och publiceras inte av Podme. Det kan innehålla reklam.

Avsnitt(364)

Luke Muehlhauser on the most important AI safety work nobody is doing

Luke Muehlhauser on the most important AI safety work nobody is doing

The US government spends 25 times more on military marching bands than on its AI safety institute. And that’s just one of the many institutions we’re missing as AI becomes more powerful and dangerous....

29 Okt 2h 36min

Why Silicon Valley can’t slow down AI on its own | Luisa Rodriguez

Why Silicon Valley can’t slow down AI on its own | Luisa Rodriguez

Two-thirds of Americans think AI is moving too fast. So do the people building it. So why the hell isn’t anyone slowing down?We can’t tell when models are too dangerous. We mostly don’t know how they ...

27 Okt 21min

Tom Milton on how we could verify a US–China deal on AI

Tom Milton on how we could verify a US–China deal on AI

If the US and China agreed to pause frontier AI training, how would either side confirm the other was complying? Today, Tom Milton argues, the most likely answer would be to shut down data centres ent...

23 Okt 1h 48min

AI lab staff: Has your project been overtaken by events? 8 strategic updates | Rob Wiblin

AI lab staff: Has your project been overtaken by events? 8 strategic updates | Rob Wiblin

I have a plea for all staff at AI companies: reassess if your current role is still your best opportunity for impact. And if it’s not — move.Frontier lab staff listening to this show will mostly alrea...

21 Okt 14min

Introducing our new YouTube channel: Zershaaneh Talks AI

Introducing our new YouTube channel: Zershaaneh Talks AI

Our host Zershaaneh Qureshi has just launched a new YouTube channel: Zershaaneh Talks AI — featuring conversations about who should control AI, how to control AI, and who gets the benefits.The first e...

20 Okt 1min

How to get into AI safety in 3 months (article reading by career advisor Matt Beard)

How to get into AI safety in 3 months (article reading by career advisor Matt Beard)

The AI safety field has grown by about 30x in the last eight years. Yet it is still in need of more people. Many want to help, but don’t know where to start. As an advisor at 80,000 Hours, Matt Beard ...

15 Okt 18min

OpenAI Security: Controlling Models is Now ‘Hell’ (AI Explained cross-post)

OpenAI Security: Controlling Models is Now ‘Hell’ (AI Explained cross-post)

This is an (unpaid) cross-post of a video from the podcast 'AI Explained', which Rob Wiblin thought you might be interested in.You can find the original on YouTube here. If you like it and want more s...

9 Okt 40min

In 2023 Ajeya Cotra already knew what was coming (classic episode)

In 2023 Ajeya Cotra already knew what was coming (classic episode)

We're rereleasing some of older episodes that seem more relevant than ever with new rogue AI incidents now seemingly announced every day. Ajeya was one of three independent investigators into the Hugg...

8 Okt 2h 46min

Populärt inom Utbildning

husmodern-med-amanda-schulman
rss-bara-en-till-om-beroende-medberoende
historiepodden-se
det-skaver
rosceremoni
nu-blir-det-historia
harrisons-dramatiska-historia
sektledare
rss-dr-bjorklund
not-fanny-anymore
rss-viktmedicinpodden
allt-du-velat-veta
johannes-hansen-podcast
roda-vita-rosen
i-vantan-pa-katastrofen
sa-in-i-sjalen
rss-max-tant-med-max-villman
rss-foraldramotet-bring-lagercrantz
kan-jag-sa-kan-du-podden
sex-pa-riktigt-med-marika-smith