AI and Existential Risk - Overview and Discussion
Last Week in AI30 Aug 2023

AI and Existential Risk - Overview and Discussion

A special non-news episode in which Andrey and Jeremie discussion AI X-Risk!

Please let us know if you'd like use to record more of this sort of thing by emailing contact@lastweekin.ai or commenting whether you listen.

Outline:

(00:00) Intro
(03:55) Topic overview
(10:22) Definitions of terms
(35:25) AI X-Risk scenarios
(41:00) Pathways to Extinction
(52:48) Relevant assumptions
(58:45) Our positions on AI X-Risk
(01:08:10) General Debate
(01:31:25) Positive/Negative transfer
(01:37:40) X-Risk within 5 years
(01:46:50) Can we control an AGI
(01:55:22) AI Safety Aesthetics
(02:00:53) Recap
(02:02:20) Outer vs inner alignment
(02:06:45) AI safety and policy today
(02:15:35) Outro

Links

Taxonomy of Pathways to Dangerous AI

Clarifying AI X-risk

Existential Risks and Global Governance Issues Around AI and Robotics

Current and Near-Term AI as a Potential Existential Risk Factor

AI x-risk, approximately ordered by embarrassment

Classification of Global Catastrophic Risks Connected with Artificial Intelligence

X-Risk Analysis for AI Research

The Alignment Problem from a Deep Learning Perspective

See Privacy Policy at https://art19.com/privacy and California Privacy Notice at https://art19.com/privacy#do-not-sell-my-info.

Episoder(277)

#230 - 2025 Retrospective, Nvidia buys Groq, GLM 4.7, METR

#230 - 2025 Retrospective, Nvidia buys Groq, GLM 4.7, METR

Our 230th episode with a summary and discussion of last week's big AI news!Recorded on 01/02/2026Hosted by Andrey Kurenkov and Jeremie HarrisFeel free to email us your questions and feedback at contac...

7 Jan 1h 38min

#229 - Gemini 3 Flash, ChatGPT Apps, Nemotron 3

#229 - Gemini 3 Flash, ChatGPT Apps, Nemotron 3

Our 229th episode with a summary and discussion of last week's big AI news!Recorded on 12/19/2025Hosted by Andrey Kurenkov and Jeremie HarrisFeel free to email us your questions and feedback at contac...

25 Des 20251h 27min

#228 - GPT 5.2, Scaling Agents, Weird Generalization

#228 - GPT 5.2, Scaling Agents, Weird Generalization

Our 228th episode with a summary and discussion of last week's big AI news!Recorded on 12/12/2025Hosted by Andrey Kurenkov and Jeremie HarrisFeel free to email us your questions and feedback at contac...

17 Des 20251h 26min

#227 - Jeremie is back! DeepSeek 3.2, TPUs, Nested Learning

#227 - Jeremie is back! DeepSeek 3.2, TPUs, Nested Learning

Our 227th episode with a summary and discussion of last week's big AI news!Recorded on 12/05/2025Hosted by Andrey Kurenkov and Jeremie HarrisFeel free to email us your questions and feedback at contac...

9 Des 20251h 34min

#226 - Gemini 3, Claude Opus 4.5, Nano Banana Pro, LeJEPA

#226 - Gemini 3, Claude Opus 4.5, Nano Banana Pro, LeJEPA

Our 226th episode with a summary and discussion of last week's big AI news!Recorded on 11/24/2025Hosted by Andrey Kurenkov and co-hosted by Michelle LeeFeel free to email us your questions and feedbac...

30 Nov 20251h 11min

#225 - GPT 5.1, Kimi K2 Thinking, Remote Labor Index

#225 - GPT 5.1, Kimi K2 Thinking, Remote Labor Index

Our 225th episode with a summary and discussion of last week's big AI news!Recorded on 11/16/2025Hosted by Andrey Kurenkov and co-hosted by Michelle LeeFeel free to email us your questions and feedbac...

21 Nov 20251h 18min

#224 - OpenAI is for-profit! Cursor 2, Minimax M2, Udio copyright

#224 - OpenAI is for-profit! Cursor 2, Minimax M2, Udio copyright

Our 224th episode with a summary and discussion of last week's big AI news!Recorded on 10/31/2025Hosted by Andrey Kurenkov and co-hosted by Gavin Purcell (check out AI For Humans and AndThen!)Feel fre...

5 Nov 20251h 31min

#223 - Haiku 4.5, OpenAI DevDay, Claude Skills, Scaling RL, SB 243

#223 - Haiku 4.5, OpenAI DevDay, Claude Skills, Scaling RL, SB 243

Our 223st episode with a summary and discussion of last week's big AI news!Recorded on 10/17/2025Hosted by Andrey Kurenkov and co-hosted by Erik SchnultzFeel free to email us your questions and feedba...

24 Okt 20251h 11min

Populært innen Politikk og nyheter

giver-og-gjengen-vg
aftenpodden
aftenpodden-usa
forklart
lydartikler-fra-aftenposten
popradet
stopp-verden
fotballpodden-2
dine-penger-pengeradet
det-store-bildet
rss-gukild-johaug
i-retten
nokon-ma-ga
hanna-de-heldige
e24-podden
rss-ness
aftenbla-bla
rss-dannet-uten-piano
frokostshowet-pa-p5
grasoner-den-nye-kalde-krigen