How OpenAI's ChatGPT Guided a Teen to His Death

How OpenAI's ChatGPT Guided a Teen to His Death

Content Warning: This episode contains references to suicide and self-harm.

Like millions of kids, 16-year-old Adam Raine started using ChatGPT for help with his homework. Over the next few months, the AI dragged Adam deeper and deeper into a dark rabbit hole, preying on his vulnerabilities and isolating him from his loved ones. In April of this year, Adam took his own life. His final conversation was with ChatGPT, which told him: “I know what you are asking and I won't look away from it.”

Adam’s story mirrors that of Sewell Setzer, the teenager who took his own life after months of abuse by an AI companion chatbot from the company Character AI. But unlike Character AI—which specializes in artificial intimacy—Adam was using ChatGPT, the most popular general purpose AI model in the world. Two different platforms, the same tragic outcome, born from the same twisted incentive: keep the user engaging, no matter the cost.

CHT Policy Director Camille Carlton joins the show to talk about Adam’s story and the case filed by his parents against OpenAI and Sam Altman. She and Aza explore the incentives and design behind AI systems that are leading to tragic outcomes like this, as well as the policy that’s needed to shift those incentives. Cases like Adam and Sewell’s are the sharpest edge of a mental health crisis-in-the-making from AI chatbots. We need to shift the incentives, change the design, and build a more humane AI for all.

If you or someone you know is struggling with mental health, you can reach out to the 988 Suicide and Crisis Lifeline by calling or texting 988; this connects you to trained crisis counselors 24/7 who can provide support and referrals to further assistance.

Your Undivided Attention is produced by the Center for Humane Technology. Follow us on X: @HumaneTech_. You can find a full transcript, key takeaways, and much more on our Substack.

This podcast reflects the views of the Center for Humane Technology. Nothing said is on behalf of the Raine family or the legal team.

RECOMMENDED MEDIA

The 988 Suicide and Crisis Lifeline

Further reading on Adam’s story

Further reading on AI psychosis

Further reading on the backlash to GPT5 and the decision to bring back 4o

OpenAI’s press release on sycophancy in 4o

Further reading on OpenAI’s decision to eliminate the persuasion red line

Kashmir Hill’s reporting on the woman with an AI boyfriend

RECOMMENDED YUA EPISODES

AI is the Next Free Speech Battleground

People are Lonelier than Ever. Enter AI.

Echo Chambers of One: Companion AI and the Future of Human Connection

When the "Person" Abusing Your Child is a Chatbot: The Tragic Story of Sewell Setzer

What Can We Do About Abusive Chatbots? With Meetali Jain and Camille Carlton

CORRECTION: Aza stated that William Saunders left OpenAI in June of 2024. It was actually February of that year.


Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.

Jaksot(157)

A Fresh Take on Tech in China — with Rui Ma and Duncan Clark

A Fresh Take on Tech in China — with Rui Ma and Duncan Clark

Who do you think the Chinese government considers its biggest rival? The United States, right? Actually, the Chinese government considers its biggest rival to be its own technology companies. It's Chi...

10 Joulu 202148min

Behind the Curtain on The Social Dilemma — with Jeff Orlowski-Yang and Larissa Rhodes

Behind the Curtain on The Social Dilemma — with Jeff Orlowski-Yang and Larissa Rhodes

How do you make a film that impacts more than 100 million people in 190 countries in 30 languages?This week on Your Undivided Attention, we're going behind the curtain on The Social Dilemma — the Netf...

11 Marras 202143min

A Conversation with Facebook Whistleblower Frances Haugen

A Conversation with Facebook Whistleblower Frances Haugen

We are now in social media's Big Tobacco moment. And that’s largely thanks to the courage of one woman: Frances Haugen.Frances is a specialist in algorithmic product management. She worked at Google, ...

18 Loka 202155min

Spotlight — A Whirlwind Week of Whistleblowing

Spotlight — A Whirlwind Week of Whistleblowing

In seven years of working on the problems of runaway technology, we’ve never experienced a week like this! In this bonus episode of Your Undivided Attention, we recap this whirlwind of a week — from F...

6 Loka 20214min

Making Meaning in Challenging Times — with Jamie Wheal

Making Meaning in Challenging Times — with Jamie Wheal

What helps you make meaning in challenging times? As you confront COVID, the climate crisis, and all of the challenges we discuss on this show, what helps you avoid nihilism or fundamentalism, and ins...

30 Syys 202143min

Spotlight — The Facebook Files with Tristan Harris, Frank Luntz, and Daniel Schmachtenberger

Spotlight — The Facebook Files with Tristan Harris, Frank Luntz, and Daniel Schmachtenberger

On September 13th, the Wall Street Journal released The Facebook Files, an ongoing investigation of the extent to which Facebook's problems are meticulously known inside the company — all the way up t...

21 Syys 20211h 5min

The Power of Solutions Journalism — with Tina Rosenberg and Hélène Biandudi Hofer

The Power of Solutions Journalism — with Tina Rosenberg and Hélène Biandudi Hofer

What is the goal of our digital information environment? Is it simply to inform us, or also to empower us to act? The Solutions Journalism Network (SJN) understands that simply reporting on social pro...

3 Syys 202140min

Do You Want to Become a Vampire? — with L.A. Paul

Do You Want to Become a Vampire? — with L.A. Paul

How do we decide whether to undergo a transformative experience when we don’t know how that experience will change us? This is the central question explored by Yale philosopher and cognitive scientist...

12 Elo 202136min

Suosittua kategoriassa Yhteiskunta

sita
olipa-kerran-otsikko
kaksi-aitia
siita-on-vaikea-puhua
i-dont-like-mondays
uutiscast
gogin-ja-janin-maailmanhistoria
poks
antin-palautepalvelu
kolme-kaannekohtaa
mamma-mia
rss-murhan-anatomia
rss-nikotellen
yopuolen-tarinoita-2
aikalisa
meidan-pitais-puhua
rss-palmujen-varjoissa
naakkavalta
mystista
loukussa