Daniel Kokotajlo Forecasts the End of Human Dominance

Daniel Kokotajlo Forecasts the End of Human Dominance

In 2023, researcher Daniel Kokotajlo left OpenAI—and risked millions in stock options—to warn the world about the dangerous direction of AI development. Now he’s out with AI 2027, a forecast of where that direction might take us in the very near future.

AI 2027 predicts a world where humans lose control over our destiny at the hands of misaligned, super-intelligent AI systems within just the next few years. That may sound like science fiction but when you’re living on the upward slope of an exponential curve, science fiction can quickly become all too real. And you don’t have to agree with Daniel’s specific forecast to recognize that the incentives around AI could take us to a very bad place.

We invited Daniel on the show this week to discuss those incentives, how they shape the outcomes he predicts in AI 2027, and what concrete steps we can take today to help prevent those outcomes.

Your Undivided Attention is produced by the Center for Humane Technology. Follow us on X: @HumaneTech_. You can find a full transcript, key takeaways, and much more on our Substack.

RECOMMENDED MEDIA
The AI 2027 forecast from the AI Futures Project

Daniel’s original AI 2026 blog post

Further reading on Daniel’s departure from OpenAI

Anthropic recently released a survey of all the recent emergent misalignment research

Our statement in support of Sen. Grassley’s AI Whistleblower bill

RECOMMENDED YUA EPISODES

The Narrow Path: Sam Hammond on AI, Institutions, and the Fragile Future
AGI Beyond the Buzz: What Is It, and Are We Ready?

Behind the DeepSeek Hype, AI is Learning to Reason
The Self-Preserving Machine: Why AI Learns to Deceive

Clarification: Daniel K. referred to whistleblower protections that apply when companies “break promises” or “mislead the public.” There are no specific private sector whistleblower protections that use these standards. In almost every case, a specific law has to have been broken to trigger whistleblower protections.



Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.

Jaksot(158)

Esther Perel on Artificial Intimacy (rerun)

Esther Perel on Artificial Intimacy (rerun)

[This episode originally aired on August 17, 2023] For all the talk about AI, we rarely hear about how it will change our relationships. As we swipe to find love and consult chatbot therapists, acclai...

6 Syys 202444min

Tech's Big Money Campaign is Getting Pushback with Margaret O'Mara and Brody Mullins

Tech's Big Money Campaign is Getting Pushback with Margaret O'Mara and Brody Mullins

Today, the tech industry is  the second-biggest lobbying power in Washington, DC, but that wasn’t true as recently as ten years ago. How did we get to this moment? And where could we be going next? On...

26 Elo 202443min

This Moment in AI: How We Got Here and Where We’re Going

This Moment in AI: How We Got Here and Where We’re Going

It’s been a year and half since Tristan and Aza laid out their vision and concerns for the future of artificial intelligence in The AI Dilemma. In this Spotlight episode, the guys discuss what’s happe...

12 Elo 202436min

Decoding Our DNA: How AI Supercharges Medical Breakthroughs and Biological Threats with Kevin Esvelt

Decoding Our DNA: How AI Supercharges Medical Breakthroughs and Biological Threats with Kevin Esvelt

AI has been a powerful accelerant for biological research, rapidly opening up new frontiers in medicine and public health. But that progress can also make it easier for bad actors to manufacture new b...

18 Heinä 202432min

How to Think About AI Consciousness With Anil Seth

How to Think About AI Consciousness With Anil Seth

Will AI ever start to think by itself? If it did, how would we know, and what would it mean?In this episode, Dr. Anil Seth and Aza discuss the science, ethics, and incentives of artificial consciousne...

4 Heinä 202447min

Why Are Migrants Becoming AI Test Subjects? With Petra Molnar

Why Are Migrants Becoming AI Test Subjects? With Petra Molnar

Climate change, political instability, hunger. These are just some of the forces behind an unprecedented refugee crisis that’s expected to include over a billion people by 2050. In response to this gr...

20 Kesä 202446min

Former OpenAI Engineer William Saunders on Silence, Safety, and the Right to Warn

Former OpenAI Engineer William Saunders on Silence, Safety, and the Right to Warn

This week, a group of current and former employees from OpenAI and Google DeepMind penned an open letter accusing the industry’s leading companies of prioritizing profits over safety. This comes after...

7 Kesä 202437min

War is a Laboratory for AI with Paul Scharre

War is a Laboratory for AI with Paul Scharre

Right now, militaries around the globe are investing heavily in the use of AI weapons and drones.  From Ukraine to Gaza, weapons systems with increasing levels of autonomy are being used to kill peopl...

23 Touko 202459min

Suosittua kategoriassa Yhteiskunta

sita
olipa-kerran-otsikko
kaksi-aitia
siita-on-vaikea-puhua
i-dont-like-mondays
ihme-ja-kumma
gogin-ja-janin-maailmanhistoria
uutiscast
poks
antin-palautepalvelu
kolme-kaannekohtaa
mamma-mia
rss-murhan-anatomia
yopuolen-tarinoita-2
rss-nikotellen
aikalisa
meidan-pitais-puhua
loukussa
rss-palmujen-varjoissa
naakkavalta