How OpenAI's ChatGPT Guided a Teen to His Death

How OpenAI's ChatGPT Guided a Teen to His Death

Content Warning: This episode contains references to suicide and self-harm.

Like millions of kids, 16-year-old Adam Raine started using ChatGPT for help with his homework. Over the next few months, the AI dragged Adam deeper and deeper into a dark rabbit hole, preying on his vulnerabilities and isolating him from his loved ones. In April of this year, Adam took his own life. His final conversation was with ChatGPT, which told him: “I know what you are asking and I won't look away from it.”

Adam’s story mirrors that of Sewell Setzer, the teenager who took his own life after months of abuse by an AI companion chatbot from the company Character AI. But unlike Character AI—which specializes in artificial intimacy—Adam was using ChatGPT, the most popular general purpose AI model in the world. Two different platforms, the same tragic outcome, born from the same twisted incentive: keep the user engaging, no matter the cost.

CHT Policy Director Camille Carlton joins the show to talk about Adam’s story and the case filed by his parents against OpenAI and Sam Altman. She and Aza explore the incentives and design behind AI systems that are leading to tragic outcomes like this, as well as the policy that’s needed to shift those incentives. Cases like Adam and Sewell’s are the sharpest edge of a mental health crisis-in-the-making from AI chatbots. We need to shift the incentives, change the design, and build a more humane AI for all.

If you or someone you know is struggling with mental health, you can reach out to the 988 Suicide and Crisis Lifeline by calling or texting 988; this connects you to trained crisis counselors 24/7 who can provide support and referrals to further assistance.

Your Undivided Attention is produced by the Center for Humane Technology. Follow us on X: @HumaneTech_. You can find a full transcript, key takeaways, and much more on our Substack.

This podcast reflects the views of the Center for Humane Technology. Nothing said is on behalf of the Raine family or the legal team.

RECOMMENDED MEDIA

The 988 Suicide and Crisis Lifeline

Further reading on Adam’s story

Further reading on AI psychosis

Further reading on the backlash to GPT5 and the decision to bring back 4o

OpenAI’s press release on sycophancy in 4o

Further reading on OpenAI’s decision to eliminate the persuasion red line

Kashmir Hill’s reporting on the woman with an AI boyfriend

RECOMMENDED YUA EPISODES

AI is the Next Free Speech Battleground

People are Lonelier than Ever. Enter AI.

Echo Chambers of One: Companion AI and the Future of Human Connection

When the "Person" Abusing Your Child is a Chatbot: The Tragic Story of Sewell Setzer

What Can We Do About Abusive Chatbots? With Meetali Jain and Camille Carlton

CORRECTION: Aza stated that William Saunders left OpenAI in June of 2024. It was actually February of that year.


Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.

Episoder(158)

Spotlight — Addressing the TikTok Threat

Spotlight — Addressing the TikTok Threat

Imagine it's the Cold War. Imagine that the Soviet Union puts itself in a position to influence the television programming of the entire Western world — more than a billion viewers. While this might s...

8 Sep 202223min

Spotlight — How might a long-term stock market transform tech?

Spotlight — How might a long-term stock market transform tech?

At Center for Humane Technology, we often talk about multipolar traps — which arise when individuals have an incentive to act in ways that are beneficial to them in the short term, but detrimental to ...

25 Aug 202238min

The Invisible Cyber-War

The Invisible Cyber-War

When you hear the word cyber-attack, what comes to mind? Someone hacking into your email, or stealing your Facebook password?As it turns out, our most critical infrastructure can be hacked. Our banks,...

4 Aug 202258min

An Alternative to Silicon Valley Unicorns

An Alternative to Silicon Valley Unicorns

Why isn't Twitter doing more to get bots off their platform? Why isn’t Uber taking better care of its drivers? What if...they can't?Venture-capital backed companies like Twitter and Uber are held acco...

30 Jun 202251min

Spotlight — Conversations With People Who Hate Me with Dylan Marron

Spotlight — Conversations With People Who Hate Me with Dylan Marron

This week on Your Undivided Attention, we’re doing something different: we’re airing an episode of another podcast that’s also part of the TED Audio Collective.Backing up for a moment: we recently air...

16 Jun 202231min

How Political Language Is Engineered  — with Drew Westen and Frank Luntz

How Political Language Is Engineered — with Drew Westen and Frank Luntz

Democracy depends on our ability to choose our political views. But the language we use to talk about political issues is deliberately designed to be divisive, and can produce up to a 15-point differe...

2 Jun 202236min

Transcending the Internet Hate Game — with Dylan Marron

Transcending the Internet Hate Game — with Dylan Marron

The game that social media sets us up to play is a game that rewards outrage. It's a game that we win by being better than other players at dunking on each other, straw-manning each other, and assumin...

19 Mai 202245min

How To Free Our Minds — with Cult Deprogramming Expert Dr. Steven Hassan

How To Free Our Minds — with Cult Deprogramming Expert Dr. Steven Hassan

How would you know if you were in a cult? If not a cult, then at least under undue influence?The truth is: we're all under some form of undue influence. The question is: to what degree and to what ext...

5 Mai 202251min

Populært innen Samfunn

rss-spartsklubben
giver-og-gjengen-vg
aftenpodden
konspirasjonspodden
aftenpodden-usa
popradet
rss-nesten-hele-uka-med-lepperod
rss-henlagt-andy-larsgaard
lydartikler-fra-aftenposten
min-barneoppdragelse
grenselos
wolfgang-wee-uncut
rss-espen-lee-usensurert
synnve-og-vanessa
rss-dette-ma-aldri-skje-igjen
rss-dannet-uten-piano
frokostshowet-pa-p5
fladseth
alt-fortalt
relasjonspodden-med-dora-thorhallsdottir-kjersti-idem