Win-Win with Liv Boeree3 Huhti 2025

#39 - Daniel Kokotajlo - Wargames, Superintelligence & Quitting OpenAI

AI is developing at breakneck speed—but are we properly prepared for what’s coming?

To explore this question Igor and I grabbed leading AI researcher and forecaster Daniel Kokotajlo for a conversation about why he left OpenAI, what's right and wrong with their company culture, and how tabletop wargames are one of the best tools we have to prepare for AGI and superintelligence in the current hyper-competitive environment.

Learn how these simulations—often used by militaries—can help us better forecast the geopolitical and technical dynamics of AI development, and why so many of them end with one person taking over the world. The gang also explore the challenges of AI alignment, incentive structures and reasons for hope. And of course, lots of predictions. Win-Win!

Chapters

0:00 - Intro

01:06 - AI Wargame & Superintelligence

05:15 - Resigning from OpenAI

09:15 - That Non-Disparagement Clause & His Equity

12:50 - Could OpenAI's behavior be Justified?

20:50 - Governance in a world with AGI

23:49 - Grading Daniel's AI predictions

31:37 - Hyperstition yay or nay?

38:09 - AI war games

46:50 - AI deception and misalignment

53:27 - More AI war games

1:03:16 - Common sense AI policies

1:23:01 - Science Fiction

1:27:12 - Rapid fire predictions

Links :

♾️ Daniel's new Predictions : https://ai-2027.com

♾️ His Historic predictions : https://www.alignmentforum.org/posts/6Xgy6CAf2jqHhynHL/what-2026-looks-like

♾️ AI - Futures: https://ai-futures.org

♾️ Time Article on Daniel : https://time.com/7086285/ai-transparency-measures/

♾️ Professional Wargaming https://en.wikipedia.org/wiki/Professional_wargaming

♾️ UN Pandemic Exercise: https://www.youtube.com/watch?v=AoLw-Q8X174&list=PL9-oVXQX88esnrdhaiuRdXGG7XOVYB9Xm&index=2

♾️ Leopold Aschenbrenner’s “Situational Awareness”: https://situational-awareness.ai/wp-content/uploads/2024/06/situationalawareness.pdf

♾️ Daniel’s X: https://x.com/DKokotajlo Credits

♾️ Hosted by Liv Boeree & Igor Kurganov

♾️ Edited and Mixed by Jackson Page

♾️ Produced by Luca de Vico

The Win-Win Podcast

Poker champion Liv Boeree takes to the interview chair to tease apart the complexities of one of the most fundamental parts of human nature: competition. Liv is joined by top philosophers, gamers, artists, technologists, CEOs, scientists, athletes and more to understand how competition manifests in their world, and how to change seemingly win-lose games into Win-Wins.

Podcast links

♾️ Youtube: https://www.youtube.com/playlist?list=PLWgq0OZMtwtOIyMsVM_vksqdfWcM-b68S

♾️ Spotify: https://open.spotify.com/show/03bGVUaFZmJUmEvSHNDPdI?si=64379cc23696454f

♾️ Apple Podcasts: https://podcasts.apple.com/us/podcast/win-win-with-liv-boeree/id1724791350

♾️ Pocketcast: https://play.pocketcasts.com/podcasts/7f708340-d17c-013b-f46e-0acc26574db2

#winwinpodcast #ai #openai

Tämä jakso on lisätty Podme-palveluun avoimen RSS-syötteen kautta eikä se ole Podmen omaa tuotantoa. Siksi jakso saattaa sisältää mainontaa.

Jaksot(57)

#55 - Dean Ball x Daniel Kokotajlo Anti-Debate - Should GOVERNMENTS or MARKETS control AI?

Advanced AI is coming. Is it time for the government to step in and regulate? Or is it better in the hands of the market and tech CEOs? Or is there a more nuanced way to think about this topic entirel...

1 Huhti 1h 25min

#54 - Greg Lukianoff - Free Speech in the Age of AI

Free speech is often treated as a political issue. But what if it’s the foundational technology that makes peaceful civilization possible in the first place?I sat down with Greg Lukianoff — free speec...

11 Maalis 1h 3min

#53 - John Schultz - Why Google Made ChatGPT, Gemini & Claude Play 900,000 hands of Poker...

Which LLM is best at POKER? What about the social deception game Werewolf? This week I'm collaborating with ⁠ @googledeepmind ⁠ and ⁠ @kaggle ⁠ to explain their new “AI Game Arena” project, designed t...

6 Helmi 35min

#52 - Will MacAskill - What Comes AFTER Superintelligence?

Superintelligence is predicted to arrive within a decade. If that's true, then what comes AFTER? And how can we prepare for it?Which is why I sat down with one of the few people actively thinking abou...

27 Tammi 1h 29min

#51 - Tyler Cowen - Markets, Institutions and Why AI Hype is (Probably) Overblown

What if the biggest risk from AI isn’t superintelligence gone rogue, but the inflexibility of our human institutions?My guest today, Tyler Cowen, thinks so. Tyler is a professor at George Mason univer...

12 Tammi 1h 52min

#50 - Samantha Sweetwater - Why Indigenous Wisdom Is Important In The AI Age

What if the purpose of life is to find ways of harmonizing the forces of nature, including the nature of ourselves?My guest this week thinks so. I sat down with systems thinker and "True Human" author...

17 Joulu 20252h 11min

#49 - British Politician Katie Lam - Defeating Grooming Gangs, Stagnation & Safetyism

Britain was once a beacon of liberty, and the birthplace of the industrial revolution. So why is its economy floundering, while the USA is surging? Has a culture of extreme bureaucracy turned the form...

25 Marras 20252h 20min

#48 - Jim Rutt - Why Capitalism Is Now A Game of Mind Control

Capitalism has historically been our biggest blessing. But what if it's now turning into our biggest curse? Is it time to change the game?My guest today believes so. Jim Rutt is an early internet pion...

8 Loka 20252h 30min