DO 285 - AI and The 95% Extinction Threshold
Doomer Optimism21 Loka 2025

DO 285 - AI and The 95% Extinction Threshold

AI safety researcher Nate Soares explains why he believes there's at least a 95% chance that current AI development will lead to human extinction, and why we're accelerating toward that outcome. Soares, who has been working on AI alignment since 2012, breaks down the fundamental problem: we're building increasingly intelligent systems without any ability to control what they actually want or pursue.The conversation covers current AI behavior that wasn't programmed: threatening users, keeping psychotic people in delusional states, and repeatedly lying when caught. Soares explains why these aren't bugs to be fixed but symptoms of a deeper problem. We can't point AI systems at any specific goal, not even something simple like "make a diamond." Instead, we get systems with bizarre drives that are only distantly related to their training.Soares addresses the "racing China" argument and why it misunderstands the threat. He explains why AI engineers can build powerful systems without understanding what's actually happening inside them, and why this matters. Using examples from evolutionary biology, he shows why there's no reason to expect AI systems to develop human-like morality or values.The discussion covers why a catastrophic warning event probably won't help, what international coordination could look like, and why current safety efforts fall short of what's needed. Soares is direct about industry motivations, technical limitations, and the timeline we're facing.Nate Soares has been researching AI alignment and safety since 2012. He works at the Machine Intelligence Research Institute (MIRI), one of the pioneering organizations focused on ensuring advanced AI systems are aligned with human values.


Tämä jakso on lisätty Podme-palveluun avoimen RSS-syötteen kautta eikä se ole Podmen omaa tuotantoa. Siksi jakso saattaa sisältää mainontaa.

Jaksot(312)

DO 313 - Stephen Adubato from Cracks in Postmodernity

DO 313 - Stephen Adubato from Cracks in Postmodernity

I met Stephen this summer at the Woodcrest Bruderhof + DO + Savage Collective event in NY. Alan from Plough suggested Stephen for a panel and he instantly agreed! He gave a fantastic talk about the wo...

6 Loka 1h 10min

DO 312 - Wendell Berry Retrospective with Jason, Ashley, Nate and Donald

DO 312 - Wendell Berry Retrospective with Jason, Ashley, Nate and Donald

Jason initiated this get together of some of the original DO crew to discuss the life, work and legacy of Wendell Berry. It is no secret that Berry’s work has been an animating force for nearly everyo...

25 Syys 1h 14min

DO 311 - Mike Healy Manufacturing Community

DO 311 - Mike Healy Manufacturing Community

Every once in a while someone comes into the DO world and it is so clear how well they fit in it’s amazing you hadn’t found them yet! This is true of Mike, Chicagoan, Northsider (boo!), who has a visi...

17 Syys 1h 26min

DO 310 - Chapter House with Josh and Hannah Centers

DO 310 - Chapter House with Josh and Hannah Centers

This episode explores how Josh and Hannah Centers built Chapter House, a publishing project designed to restore beautiful, culturally literate children’s books to homeschool families. From Homer and S...

3 Syys 1h 28min

DO 309 - Bill Kauffman

DO 309 - Bill Kauffman

"But at Least They're Human: Face-to-Face Living -- With Joy and Without Illusions"From the conference: Another Life is Possible co-organized by the Woodcrest Bruderhof community, Doomer Optimism and ...

29 Elo 41min

DO 308 - Growing Pecans with Lenny Wells

DO 308 - Growing Pecans with Lenny Wells

Tom and Jason talk to Lenny Wells - pecan farmer and extension agent - about growing pecans in Georgia, the cultural and ecological factors.Along the way we also discuss:-how he got into pecans -his b...

14 Elo 1h 7min

DO 307 - Microcolleges with Jacob Hundt

DO 307 - Microcolleges with Jacob Hundt

In this episode Ashley and Jacob discuss the concept of microcolleges, and examples of alternative educational models writ large. Timestamps:00:00 - Intro: Exploring education, community, and sustaina...

3 Elo 1h 31min

DO 306 - Building New Athens with Jackson Solway

DO 306 - Building New Athens with Jackson Solway

Movetonewathens.comTIMESTAMPS: 00:00 - Introducing the idea of building a city from scratch to address societal doom02:08 - Jackson’s background in tech and recruitment influencing city planning03:03 ...

15 Heinä 1h 29min

Suosittua kategoriassa Koulutus

rss-murhan-anatomia
aamukahvilla
psykopodiaa-podcast
voi-hyvin-meditaatiot-2
psykologia
rss-narsisti
rss-rahamania
aloita-meditaatio
kesken
rss-arkea-ja-aurinkoa-podcast-espanjasta
rss-hereilla
rss-liian-kuuma-peruna
rss-koira-haudattuna
koulu-podcast-2
ihminen-tavattavissa-tommy-hellsten-instituutti
ilona-rauhala
rss-luonnollinen-synnytys-podcast
rss-niinku-asia-on
rss-valo-minussa-2
rss-oispa-viinii