How OpenAI's ChatGPT Guided a Teen to His Death

How OpenAI's ChatGPT Guided a Teen to His Death

Content Warning: This episode contains references to suicide and self-harm.

Like millions of kids, 16-year-old Adam Raine started using ChatGPT for help with his homework. Over the next few months, the AI dragged Adam deeper and deeper into a dark rabbit hole, preying on his vulnerabilities and isolating him from his loved ones. In April of this year, Adam took his own life. His final conversation was with ChatGPT, which told him: “I know what you are asking and I won't look away from it.”

Adam’s story mirrors that of Sewell Setzer, the teenager who took his own life after months of abuse by an AI companion chatbot from the company Character AI. But unlike Character AI—which specializes in artificial intimacy—Adam was using ChatGPT, the most popular general purpose AI model in the world. Two different platforms, the same tragic outcome, born from the same twisted incentive: keep the user engaging, no matter the cost.

CHT Policy Director Camille Carlton joins the show to talk about Adam’s story and the case filed by his parents against OpenAI and Sam Altman. She and Aza explore the incentives and design behind AI systems that are leading to tragic outcomes like this, as well as the policy that’s needed to shift those incentives. Cases like Adam and Sewell’s are the sharpest edge of a mental health crisis-in-the-making from AI chatbots. We need to shift the incentives, change the design, and build a more humane AI for all.

If you or someone you know is struggling with mental health, you can reach out to the 988 Suicide and Crisis Lifeline by calling or texting 988; this connects you to trained crisis counselors 24/7 who can provide support and referrals to further assistance.

Your Undivided Attention is produced by the Center for Humane Technology. Follow us on X: @HumaneTech_. You can find a full transcript, key takeaways, and much more on our Substack.

This podcast reflects the views of the Center for Humane Technology. Nothing said is on behalf of the Raine family or the legal team.

RECOMMENDED MEDIA

The 988 Suicide and Crisis Lifeline

Further reading on Adam’s story

Further reading on AI psychosis

Further reading on the backlash to GPT5 and the decision to bring back 4o

OpenAI’s press release on sycophancy in 4o

Further reading on OpenAI’s decision to eliminate the persuasion red line

Kashmir Hill’s reporting on the woman with an AI boyfriend

RECOMMENDED YUA EPISODES

AI is the Next Free Speech Battleground

People are Lonelier than Ever. Enter AI.

Echo Chambers of One: Companion AI and the Future of Human Connection

When the "Person" Abusing Your Child is a Chatbot: The Tragic Story of Sewell Setzer

What Can We Do About Abusive Chatbots? With Meetali Jain and Camille Carlton

CORRECTION: Aza stated that William Saunders left OpenAI in June of 2024. It was actually February of that year.


Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.

Episoder(157)

The Promise and Peril of Open Source AI with Elizabeth Seger and Jeffrey Ladish

The Promise and Peril of Open Source AI with Elizabeth Seger and Jeffrey Ladish

As AI development races forward, a fierce debate has emerged over open source AI models. So what does it mean to open-source AI? Are we opening Pandora’s box of catastrophic risks? Or is open-sourcing...

21 Nov 202338min

A First Step Toward AI Regulation with Tom Wheeler

A First Step Toward AI Regulation with Tom Wheeler

On Monday, Oct. 30, President Biden released a sweeping executive order that addresses many risks of artificial intelligence. Tom Wheeler, former chairman of the Federal Communications Commission, sha...

2 Nov 202335min

No One is Immune to AI Harms with Dr. Joy Buolamwini

No One is Immune to AI Harms with Dr. Joy Buolamwini

In this interview, Dr. Joy Buolamwini argues that algorithmic bias in AI systems poses risks to marginalized people. She challenges the assumptions of tech leaders who advocate for AI “alignment” and ...

26 Okt 202347min

Mustafa Suleyman Says We Need to Contain AI. How Do We Do It?

Mustafa Suleyman Says We Need to Contain AI. How Do We Do It?

This is going to be the most productive decade in the history of our species, says Mustafa Suleyman, author of “The Coming Wave,” CEO of Inflection AI, and founder of Google’s DeepMind. But in order t...

28 Sep 202332min

Inside the First AI Insight Forum in Washington

Inside the First AI Insight Forum in Washington

Last week, Senator Chuck Schumer brought together Congress and many of the biggest names in AI for the first closed-door AI Insight Forum in Washington, D.C. Tristan and Aza were invited speakers at t...

19 Sep 202326min

Spotlight on AI: What Would It Take For This to Go Well?

Spotlight on AI: What Would It Take For This to Go Well?

Where do the top Silicon Valley AI researchers really think  AI is headed? Do they have a plan if things go wrong?  In this episode, Tristan Harris and Aza Raskin reflect on the last several months of...

12 Sep 202343min

The AI ‘Race’: China vs. the US with Jeffrey Ding and Karen Hao

The AI ‘Race’: China vs. the US with Jeffrey Ding and Karen Hao

In the debate over slowing down AI, we often hear the same argument against regulation.   “What about China? We can’t let China get ahead.” To dig into the nuances of this argument, Tristan and Aza sp...

31 Aug 202345min

Esther Perel on Artificial Intimacy

Esther Perel on Artificial Intimacy

For all the talk about AI, we rarely hear about how it will change our relationships. As we swipe to find love and consult chatbot therapists, acclaimed psychotherapist and relationship expert Esther ...

17 Aug 202344min

Populært innen Samfunn

rss-spartsklubben
giver-og-gjengen-vg
aftenpodden
konspirasjonspodden
aftenpodden-usa
popradet
rss-nesten-hele-uka-med-lepperod
rss-henlagt-andy-larsgaard
wolfgang-wee-uncut
lydartikler-fra-aftenposten
grenselos
min-barneoppdragelse
alt-fortalt
rss-dette-ma-aldri-skje-igjen
synnve-og-vanessa
rss-dannet-uten-piano
fladseth
198-land-med-einar-trnquist
opptur-med-annette-og-ingeborg
rss-lilli-isabelle