How OpenAI's ChatGPT Guided a Teen to His Death

How OpenAI's ChatGPT Guided a Teen to His Death

Content Warning: This episode contains references to suicide and self-harm.

Like millions of kids, 16-year-old Adam Raine started using ChatGPT for help with his homework. Over the next few months, the AI dragged Adam deeper and deeper into a dark rabbit hole, preying on his vulnerabilities and isolating him from his loved ones. In April of this year, Adam took his own life. His final conversation was with ChatGPT, which told him: “I know what you are asking and I won't look away from it.”

Adam’s story mirrors that of Sewell Setzer, the teenager who took his own life after months of abuse by an AI companion chatbot from the company Character AI. But unlike Character AI—which specializes in artificial intimacy—Adam was using ChatGPT, the most popular general purpose AI model in the world. Two different platforms, the same tragic outcome, born from the same twisted incentive: keep the user engaging, no matter the cost.

CHT Policy Director Camille Carlton joins the show to talk about Adam’s story and the case filed by his parents against OpenAI and Sam Altman. She and Aza explore the incentives and design behind AI systems that are leading to tragic outcomes like this, as well as the policy that’s needed to shift those incentives. Cases like Adam and Sewell’s are the sharpest edge of a mental health crisis-in-the-making from AI chatbots. We need to shift the incentives, change the design, and build a more humane AI for all.

If you or someone you know is struggling with mental health, you can reach out to the 988 Suicide and Crisis Lifeline by calling or texting 988; this connects you to trained crisis counselors 24/7 who can provide support and referrals to further assistance.

Your Undivided Attention is produced by the Center for Humane Technology. Follow us on X: @HumaneTech_. You can find a full transcript, key takeaways, and much more on our Substack.

This podcast reflects the views of the Center for Humane Technology. Nothing said is on behalf of the Raine family or the legal team.

RECOMMENDED MEDIA

The 988 Suicide and Crisis Lifeline

Further reading on Adam’s story

Further reading on AI psychosis

Further reading on the backlash to GPT5 and the decision to bring back 4o

OpenAI’s press release on sycophancy in 4o

Further reading on OpenAI’s decision to eliminate the persuasion red line

Kashmir Hill’s reporting on the woman with an AI boyfriend

RECOMMENDED YUA EPISODES

AI is the Next Free Speech Battleground

People are Lonelier than Ever. Enter AI.

Echo Chambers of One: Companion AI and the Future of Human Connection

When the "Person" Abusing Your Child is a Chatbot: The Tragic Story of Sewell Setzer

What Can We Do About Abusive Chatbots? With Meetali Jain and Camille Carlton

CORRECTION: Aza stated that William Saunders left OpenAI in June of 2024. It was actually February of that year.


Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.

Jaksot(156)

Chips Are the Future of AI. They’re Also Incredibly Vulnerable. With Chris Miller

Chips Are the Future of AI. They’re Also Incredibly Vulnerable. With Chris Miller

Beneath the race to train and release more powerful AI models lies another race: a race by companies and nation-states to secure the hardware to make sure they win AI supremacy. Correction: The latest...

29 Maalis 202445min

Future-proofing Democracy In the Age of AI with Audrey Tang

Future-proofing Democracy In the Age of AI with Audrey Tang

What does a functioning democracy look like in the age of artificial intelligence? Could AI even be used to help a democracy flourish? Just in time for election season, Taiwan’s Minister of Digital Af...

29 Helmi 202434min

U.S. Senators Grilled Social Media CEOs. Will Anything Change?

U.S. Senators Grilled Social Media CEOs. Will Anything Change?

Was it political progress, or just political theater? The recent Senate hearing with social media CEOs led to astonishing moments — including Mark Zuckerberg’s public apology to families who lost chil...

13 Helmi 202425min

Taylor Swift is Not Alone: The Deepfake Nightmare Sweeping the Internet

Taylor Swift is Not Alone: The Deepfake Nightmare Sweeping the Internet

Over the past year, a tsunami of apps that digitally strip the clothes off real people has hit the market. Now anyone can create fake non-consensual sexual images in just a few clicks. With cases prol...

1 Helmi 202442min

Can Myth Teach Us Anything About the Race to Build Artificial General Intelligence? With Josh Schrei

Can Myth Teach Us Anything About the Race to Build Artificial General Intelligence? With Josh Schrei

We usually talk about tech in terms of economics or policy, but the casual language tech leaders often use to describe AI — summoning an inanimate force with the powers of code — sounds more... magica...

18 Tammi 202435min

How Will AI Affect the 2024 Elections? with Renee DiResta and Carl Miller

How Will AI Affect the 2024 Elections? with Renee DiResta and Carl Miller

2024 will be the biggest election year in world history. Forty countries will hold national elections, with over two billion voters heading to the polls. In this episode of Your Undivided Attention, t...

21 Joulu 202347min

2023 Ask Us Anything

2023 Ask Us Anything

You asked, we answered. This has been a big year in the world of tech, with the rapid proliferation of artificial intelligence, acceleration of neurotechnology, and continued ethical missteps of socia...

30 Marras 202335min

The Promise and Peril of Open Source AI with Elizabeth Seger and Jeffrey Ladish

The Promise and Peril of Open Source AI with Elizabeth Seger and Jeffrey Ladish

As AI development races forward, a fierce debate has emerged over open source AI models. So what does it mean to open-source AI? Are we opening Pandora’s box of catastrophic risks? Or is open-sourcing...

21 Marras 202338min

Suosittua kategoriassa Yhteiskunta

olipa-kerran-otsikko
sita
siita-on-vaikea-puhua
kaksi-aitia
gogin-ja-janin-maailmanhistoria
i-dont-like-mondays
uutiscast
poks
antin-palautepalvelu
rss-nikotellen
kolme-kaannekohtaa
mamma-mia
yopuolen-tarinoita-2
aikalisa
rss-murhan-anatomia
meidan-pitais-puhua
rss-haudattu
rss-palmujen-varjoissa
isani-on-terapeuttiville
taskula-trishin