How OpenAI's ChatGPT Guided a Teen to His Death

How OpenAI's ChatGPT Guided a Teen to His Death

Content Warning: This episode contains references to suicide and self-harm.

Like millions of kids, 16-year-old Adam Raine started using ChatGPT for help with his homework. Over the next few months, the AI dragged Adam deeper and deeper into a dark rabbit hole, preying on his vulnerabilities and isolating him from his loved ones. In April of this year, Adam took his own life. His final conversation was with ChatGPT, which told him: “I know what you are asking and I won't look away from it.”

Adam’s story mirrors that of Sewell Setzer, the teenager who took his own life after months of abuse by an AI companion chatbot from the company Character AI. But unlike Character AI—which specializes in artificial intimacy—Adam was using ChatGPT, the most popular general purpose AI model in the world. Two different platforms, the same tragic outcome, born from the same twisted incentive: keep the user engaging, no matter the cost.

CHT Policy Director Camille Carlton joins the show to talk about Adam’s story and the case filed by his parents against OpenAI and Sam Altman. She and Aza explore the incentives and design behind AI systems that are leading to tragic outcomes like this, as well as the policy that’s needed to shift those incentives. Cases like Adam and Sewell’s are the sharpest edge of a mental health crisis-in-the-making from AI chatbots. We need to shift the incentives, change the design, and build a more humane AI for all.

If you or someone you know is struggling with mental health, you can reach out to the 988 Suicide and Crisis Lifeline by calling or texting 988; this connects you to trained crisis counselors 24/7 who can provide support and referrals to further assistance.

Your Undivided Attention is produced by the Center for Humane Technology. Follow us on X: @HumaneTech_. You can find a full transcript, key takeaways, and much more on our Substack.

This podcast reflects the views of the Center for Humane Technology. Nothing said is on behalf of the Raine family or the legal team.

RECOMMENDED MEDIA

The 988 Suicide and Crisis Lifeline

Further reading on Adam’s story

Further reading on AI psychosis

Further reading on the backlash to GPT5 and the decision to bring back 4o

OpenAI’s press release on sycophancy in 4o

Further reading on OpenAI’s decision to eliminate the persuasion red line

Kashmir Hill’s reporting on the woman with an AI boyfriend

RECOMMENDED YUA EPISODES

AI is the Next Free Speech Battleground

People are Lonelier than Ever. Enter AI.

Echo Chambers of One: Companion AI and the Future of Human Connection

When the "Person" Abusing Your Child is a Chatbot: The Tragic Story of Sewell Setzer

What Can We Do About Abusive Chatbots? With Meetali Jain and Camille Carlton

CORRECTION: Aza stated that William Saunders left OpenAI in June of 2024. It was actually February of that year.


Hosted by Simplecast, an AdsWizz company. See pcm.adswizz.com for information about our collection and use of personal data for advertising.

Jaksot(156)

This Moment in AI: How We Got Here and Where We’re Going

This Moment in AI: How We Got Here and Where We’re Going

It’s been a year and half since Tristan and Aza laid out their vision and concerns for the future of artificial intelligence in The AI Dilemma. In this Spotlight episode, the guys discuss what’s happe...

12 Elo 202436min

Decoding Our DNA: How AI Supercharges Medical Breakthroughs and Biological Threats with Kevin Esvelt

Decoding Our DNA: How AI Supercharges Medical Breakthroughs and Biological Threats with Kevin Esvelt

AI has been a powerful accelerant for biological research, rapidly opening up new frontiers in medicine and public health. But that progress can also make it easier for bad actors to manufacture new b...

18 Heinä 202432min

How to Think About AI Consciousness With Anil Seth

How to Think About AI Consciousness With Anil Seth

Will AI ever start to think by itself? If it did, how would we know, and what would it mean?In this episode, Dr. Anil Seth and Aza discuss the science, ethics, and incentives of artificial consciousne...

4 Heinä 202447min

Why Are Migrants Becoming AI Test Subjects? With Petra Molnar

Why Are Migrants Becoming AI Test Subjects? With Petra Molnar

Climate change, political instability, hunger. These are just some of the forces behind an unprecedented refugee crisis that’s expected to include over a billion people by 2050. In response to this gr...

20 Kesä 202446min

Former OpenAI Engineer William Saunders on Silence, Safety, and the Right to Warn

Former OpenAI Engineer William Saunders on Silence, Safety, and the Right to Warn

This week, a group of current and former employees from OpenAI and Google DeepMind penned an open letter accusing the industry’s leading companies of prioritizing profits over safety. This comes after...

7 Kesä 202437min

War is a Laboratory for AI with Paul Scharre

War is a Laboratory for AI with Paul Scharre

Right now, militaries around the globe are investing heavily in the use of AI weapons and drones.  From Ukraine to Gaza, weapons systems with increasing levels of autonomy are being used to kill peopl...

23 Touko 202459min

AI and Jobs: How to Make AI Work With Us, Not Against Us With Daron Acemoglu

AI and Jobs: How to Make AI Work With Us, Not Against Us With Daron Acemoglu

Tech companies say that AI will lead to massive economic productivity gains. But as we know from the first digital revolution, that’s not what happened. Can we do better this time around?RECOMMENDED M...

9 Touko 202446min

Jonathan Haidt On How to Solve the Teen Mental Health Crisis

Jonathan Haidt On How to Solve the Teen Mental Health Crisis

Suicides. Self harm. Depression and anxiety. The toll of a social media-addicted, phone-based childhood has never been more stark. It can be easy for teens, parents and schools to feel like they’re tr...

11 Huhti 20241h 5min

Suosittua kategoriassa Yhteiskunta

olipa-kerran-otsikko
sita
siita-on-vaikea-puhua
kaksi-aitia
gogin-ja-janin-maailmanhistoria
i-dont-like-mondays
uutiscast
poks
antin-palautepalvelu
rss-nikotellen
kolme-kaannekohtaa
mamma-mia
yopuolen-tarinoita-2
aikalisa
rss-murhan-anatomia
meidan-pitais-puhua
rss-haudattu
rss-palmujen-varjoissa
isani-on-terapeuttiville
taskula-trishin