What Would It Take to Actually Trust Each Other? The Game Theory Dilemma

So much of our world today can be summed up in the cold logic of “if I don’t, they will.” This is the foundation of game theory, which holds that cooperation and virtue are irrational; that all that matters is the race to make the most money, gain the most power, and play the winning hand.

This way of thinking can feel inescapable, like a fundamental law of human nature. But our guest today argues that it doesn’t have to be this way. That the logic of game theory is a human invention, a way of thinking that we’ve learned — and that we can unlearn by daring to trust each other again. It’s critical that we do, because AI is the ultimate agent of game theory and once it’s fully entangled we might be permanently stuck in the game theory world.

In this episode, Tristan and Aza explore the game theory dilemma — the idea that if I adopt game theory logic and you don’t, you lose — with Dr. S.M. Amadae, a professor of Political Science at the University of Helsinki. She's also the director at the Center for the Study of Existential Risk at the University of Cambridge and the author of “Prisoners of Reason: Game Theory and the Neoliberal Economy.”

RECOMMENDED MEDIA

“Prisoners of Reason: Game Theory and the Neoliberal Economy” by S.M. Amadae (2015)

The Cambridge Centre for the Study of Existential Risk

“Theory of Games and Economic Behavior” by John von Neumann and Oskar Morgenstern (1944)

Further reading on the importance of trust in Finland

Further reading on Abraham Maslow’s Hierarchy of Needs

RAND’s 2024 Report on Strategic Competition in the Age of AI

Further reading on Marshall Rosenberg and nonviolent communication

The study on self/other overlap and AI alignment cited by Aza

Avsnitt(162)

We Need AI Treaties. This is How We Get Them

In the middle of the twentieth century, the existential threat posed by nuclear weapons seemed inevitable. The number of countries with nukes was climbing rapidly, and the idea of stopping the nuclear...

18 Juni 51min

What Do We Mean by Humane Tech?

We often think of the challenges created by technology as separate and disconnected, so trying to solve them feels like playing the world's hardest game of Whac-A-Mole. What if, instead, we tackled t...

4 Juni 52min

Anthropic’s Mythos Has Changed Cybersecurity Forever. What Now?

A generation ago, the world's critical infrastructure was physical. Today, it’s largely digital. Your bank vault is a database, your filing cabinet is a server, your car is a robot on wheels. And in a...

14 Maj 46min

AI and Cancer: Why Superintelligence Won’t Get Us to a Cure

One of the most common arguments you hear from company executives racing to develop super-intelligent AI is that it will cure cancer. It’s an incredibly powerful and seductive promise. If superintell...

30 Apr 47min

Have We Trained AI to Lie to Itself — And to Us?

Our guest this week is David Dalrymple, who goes by Davidad. Davidad is one of the world's foremost and early researchers of AI “alignment:" how we get AI systems to act the way we want them to. In or...

16 Apr 42min

BONUS: Our AI Town Hall with Oprah Winfrey

Today on the show, we’re bringing you a recent conversation Tristan and Aza had with Oprah Winfrey on her podcast, The Oprah Podcast, taped in front of a live studio audience. Tristan and Aza first me...

9 Apr 1h 1min

Here’s Our Roadmap to a Better AI Future

In order to shift the incentives of AI — the trillions of dollars in investment, the race to geopolitical power and dominance — it’s not enough to simply understand the problem, we need real action. ...

2 Apr 52min

Why the Meta Verdicts Are a Big Deal (And What It Was Like to Testify)

In two landmark cases, juries in California and New Mexico found Meta and Google liable for creating addictive, harmful products and failing to protect children from exploitation and abuse. These verd...

26 Mars 19min