DO 285 - AI and The 95% Extinction Threshold
Doomer Optimism21 Loka 2025

DO 285 - AI and The 95% Extinction Threshold

AI safety researcher Nate Soares explains why he believes there's at least a 95% chance that current AI development will lead to human extinction, and why we're accelerating toward that outcome. Soares, who has been working on AI alignment since 2012, breaks down the fundamental problem: we're building increasingly intelligent systems without any ability to control what they actually want or pursue.The conversation covers current AI behavior that wasn't programmed: threatening users, keeping psychotic people in delusional states, and repeatedly lying when caught. Soares explains why these aren't bugs to be fixed but symptoms of a deeper problem. We can't point AI systems at any specific goal, not even something simple like "make a diamond." Instead, we get systems with bizarre drives that are only distantly related to their training.Soares addresses the "racing China" argument and why it misunderstands the threat. He explains why AI engineers can build powerful systems without understanding what's actually happening inside them, and why this matters. Using examples from evolutionary biology, he shows why there's no reason to expect AI systems to develop human-like morality or values.The discussion covers why a catastrophic warning event probably won't help, what international coordination could look like, and why current safety efforts fall short of what's needed. Soares is direct about industry motivations, technical limitations, and the timeline we're facing.Nate Soares has been researching AI alignment and safety since 2012. He works at the Machine Intelligence Research Institute (MIRI), one of the pioneering organizations focused on ensuring advanced AI systems are aligned with human values.


Tämä jakso on lisätty Podme-palveluun avoimen RSS-syötteen kautta eikä se ole Podmen omaa tuotantoa. Siksi jakso saattaa sisältää mainontaa.

Jaksot(302)

Episode 39 - Empty America w/ Ashley Colby and Jason Snyder

Episode 39 - Empty America w/ Ashley Colby and Jason Snyder

We're back with a brand new Doomer Optimism! This time, hosts hosts Ashley Colby (@RizomaSchool) and Jason Snyder(@cognazor) settle in around the proverbial campfire for a fascinating conversation wit...

20 Touko 20221h 39min

Episode 38 - Peter Allen w/ Ashley Colby and Jason Snyder

Episode 38 - Peter Allen w/ Ashley Colby and Jason Snyder

On this episode of Doomer Optimism, hosts Ashley Colby (@RizomaSchool) and Jason Snyder(@cognazor) have a chat with Peter Allen (@pclarkallen) of Mastodon Valley Farm about ecological and regenerative...

17 Touko 20221h 22min

Episode 37 - Chris Ellis and Brad Garrett w/ Ashley Colby

Episode 37 - Chris Ellis and Brad Garrett w/ Ashley Colby

On this episode, Ashley Colby (@RizomaSchool) discusses doom, prepping and bunkers, and building resilient communities with Dr. Chris Ellis (@Prep4Disasters) and Brad Garrett (@Goblinmerchant). This i...

13 Touko 20221h 14min

Episode 36 - Euvie Ivanova w/ Ashley Colby and Jason Snyder

Episode 36 - Euvie Ivanova w/ Ashley Colby and Jason Snyder

This episode of Doomer Optimism is co-hosted by Ashley Colby and Jason Snyder, who interview Future Thinkers co-founder, Euvie Ivanova. The episode tackles motherhood, transhumanism, and the nitty-gri...

10 Touko 20221h 33min

Episode 35 - Brooke Bowman and Grin from This Part of Twitter (TPOT) w/ Ashley Colby and Jason Snyder

Episode 35 - Brooke Bowman and Grin from This Part of Twitter (TPOT) w/ Ashley Colby and Jason Snyder

This episode of Doomer Optimism sees Ashley Colby (@RizomaSchool) and Jason Snyder (@cognazor) have a wide-ranging conversation with Brooke Bowman (@gptbrooke) and Grin (@grin_io) from This Part of Tw...

6 Touko 20221h 18min

Episode 34 - Chuck Marohn w/ Anarcho- Contrarian and Kara Marshall

Episode 34 - Chuck Marohn w/ Anarcho- Contrarian and Kara Marshall

This episode of Doomer Optimism sees frequent contributor Anarcho-Contrarian (@AnarContrarian)and DO newbie Kara Marshall (@karakara98) sit down with the founder and president of Strong Towns, Charles...

4 Touko 202254min

Episode 33 - Jordan Hall w/ Ashley Colby and Jason Snyder

Episode 33 - Jordan Hall w/ Ashley Colby and Jason Snyder

If Jordan Hall were a gin and tonic, then this, Jordan's second Doomer Optimism episode, would be a G&T with special elderberry simple syrup. By which I mean, the addition of this episode's hosts, Ash...

28 Huhti 20221h 24min

Episode 32 - Dr. Morris Berman w/ Ashley Colby and Patrick Fitzgerald

Episode 32 - Dr. Morris Berman w/ Ashley Colby and Patrick Fitzgerald

On this episode of Doomer Optimism Ashley Colby (@RizomaSchool) and her husband Patrick Fitzgerald (@RizomaAt) discuss the future of American democracy and the prospects for a new dark ages with autho...

26 Huhti 20221h 2min

Suosittua kategoriassa Koulutus

rss-murhan-anatomia
psykopodiaa-podcast
voi-hyvin-meditaatiot-2
adhd-podi
rss-rahamania
rss-valo-minussa-2
rss-luonnollinen-synnytys-podcast
rss-narsisti
rahapuhetta
kesken
rss-liian-kuuma-peruna
rss-tietoinen-yhteys-podcast-2
rss-niinku-asia-on
filocast-filosofian-perusteet
ihminen-tavattavissa-tommy-hellsten-instituutti
rss-arkea-ja-aurinkoa-podcast-espanjasta
aamukahvilla
jari-sarasvuo-podcast
dear-ladies
rss-vapaudu-voimaasi