DO 285 - AI and The 95% Extinction Threshold
Doomer Optimism21 Loka 2025

DO 285 - AI and The 95% Extinction Threshold

AI safety researcher Nate Soares explains why he believes there's at least a 95% chance that current AI development will lead to human extinction, and why we're accelerating toward that outcome. Soares, who has been working on AI alignment since 2012, breaks down the fundamental problem: we're building increasingly intelligent systems without any ability to control what they actually want or pursue.The conversation covers current AI behavior that wasn't programmed: threatening users, keeping psychotic people in delusional states, and repeatedly lying when caught. Soares explains why these aren't bugs to be fixed but symptoms of a deeper problem. We can't point AI systems at any specific goal, not even something simple like "make a diamond." Instead, we get systems with bizarre drives that are only distantly related to their training.Soares addresses the "racing China" argument and why it misunderstands the threat. He explains why AI engineers can build powerful systems without understanding what's actually happening inside them, and why this matters. Using examples from evolutionary biology, he shows why there's no reason to expect AI systems to develop human-like morality or values.The discussion covers why a catastrophic warning event probably won't help, what international coordination could look like, and why current safety efforts fall short of what's needed. Soares is direct about industry motivations, technical limitations, and the timeline we're facing.Nate Soares has been researching AI alignment and safety since 2012. He works at the Machine Intelligence Research Institute (MIRI), one of the pioneering organizations focused on ensuring advanced AI systems are aligned with human values.


Tämä jakso on lisätty Podme-palveluun avoimen RSS-syötteen kautta eikä se ole Podmen omaa tuotantoa. Siksi jakso saattaa sisältää mainontaa.

Jaksot(302)

Episode 55 - Magdalena Urioste w/ Ashley Colby

Episode 55 - Magdalena Urioste w/ Ashley Colby

This episode of Doomer Optimism has Ashley Colby (@RizomaSchool) speak with Uruguayan regenerative farmer, Magdalena Urioste. Topics range from Magdalena's past as a world traveler in the United State...

16 Heinä 20221h 1min

Episode 54 - Ladi Jadi w/ Brooke Bowman and Ashley Colby

Episode 54 - Ladi Jadi w/ Brooke Bowman and Ashley Colby

This episode of Doomer Optimism is all about community building. Ashley (@RizomaSchool) brings back Brooke Bowman (@gptbrooke) of This Part of Twitter (TPOT) and vibecamp to chat with Ladi Jadi (@Ladi...

13 Heinä 202256min

Episode 53 - Roland Gunn w/ Jason Snyder and Tres Crow

Episode 53 - Roland Gunn w/ Jason Snyder and Tres Crow

This is another Appalachian-centric episode of Doomer Optimism. This time, we have Jason Snyder (@cognazor) co-hosting with Tres Crow (@dogeatcrow) as they have a discussion with Roland Gunn (@RolandG...

11 Heinä 20221h 24min

Episode 52 - John Dios w/ Ashley Colby and Willow Liana

Episode 52 - John Dios w/ Ashley Colby and Willow Liana

On this episode of Doomer Optimism, Ashley (@RizomaSchool) chats with John Dios (@FibromyalgiaDad) about rural gentrification, homesteading, catholicism, and his project Holy Agony/Cathedral in the Pi...

6 Heinä 20221h 16min

Episode 51 - SaraDay Evans w/ Dr. Josh Kearns and Jason Snyder

Episode 51 - SaraDay Evans w/ Dr. Josh Kearns and Jason Snyder

This episode of Doomer Optimism sees Jason Snyder (@cognazor) hanging out with two native children of Appalachian, returning guest/host Dr. Josh Kearns (@HillbillyNarnia) and SaraDay Evans (@esaraday)...

1 Heinä 20221h 26min

Episode 50 - Panel w/ Kate Raworth, Nora Bateson, Joe Brewer, Daniel Christian Wahl, and Jason Snyder

Episode 50 - Panel w/ Kate Raworth, Nora Bateson, Joe Brewer, Daniel Christian Wahl, and Jason Snyder

On this, our 50th episode of Doomer Optimism, Jason Snyder (@cognazor) hosts a panel discussion with some of the brightest minds in regeneration. Joe Brewer (@cognitivepolicy), Kate Raworth (@KateRawo...

28 Kesä 20221h 57min

Episode 49 - Stephanie Lepp w/ Ashley Colby and Jason Snyder

Episode 49 - Stephanie Lepp w/ Ashley Colby and Jason Snyder

On episode 49 of Doomer Optimism, Ashley Colby (@RizomaSchool) and Jason Snyder (@cognazor) sit down with Stephanie Lepp (@stephlepp), Executive Producer at the Center for Humane Technology. They disc...

25 Kesä 20221h 23min

Episode 48 - Bosco and Ourania w/ Ashley Colby

Episode 48 - Bosco and Ourania w/ Ashley Colby

On this episode, Ashley Colby (@RizomaSchool) continues her informal "Based Mommy" series with two incredible anon women, Bosco (@selentelechia) and Ourania (@ouranometrian). Topics obviously include ...

21 Kesä 20221h 4min

Suosittua kategoriassa Koulutus

rss-murhan-anatomia
psykopodiaa-podcast
voi-hyvin-meditaatiot-2
adhd-podi
rss-rahamania
rss-valo-minussa-2
rss-luonnollinen-synnytys-podcast
rss-narsisti
rahapuhetta
kesken
rss-liian-kuuma-peruna
rss-tietoinen-yhteys-podcast-2
rss-niinku-asia-on
filocast-filosofian-perusteet
ihminen-tavattavissa-tommy-hellsten-instituutti
rss-arkea-ja-aurinkoa-podcast-espanjasta
aamukahvilla
jari-sarasvuo-podcast
dear-ladies
rss-vapaudu-voimaasi