Why Silicon Valley can’t slow down AI on its own

Why Silicon Valley can’t slow down AI on its own

Two-thirds of Americans think AI is moving too fast. So do the people building it. So why the hell isn’t anyone slowing down?

We can’t tell when models are too dangerous. We mostly don’t know how they work. We don’t know how to make them do what we want. And our two main safety checks — testing behaviour and monitoring their ‘thoughts’ — are breaking down.

Yet we’re racing to build more powerful AI anyway, faster every year. And it’s only going to accelerate as AI itself gets better and better at building the next generation of models.

Earlier this year, OpenAI found its new model, Astra, was alarmingly good at hacking, and did something companies almost never do: paused its biggest training project. But it released Astra anyway, even though tests couldn’t prove if it was safe.

That’s the problem with leaving it up to the companies. We can’t trust them to act in our best interest because the competitive pressures for them to race ahead are too strong.

So what’s the solution? Luisa Rodriguez evaluates the likely candidates:

  1. Safety checkpoints when new models can hack, work unsupervised, or build bioweapons
  2. Restricting computing power as a speed limit on AI development
  3. Preventing AI from being used to create more powerful AI
  4. Pausing development altogether

None of these will be easy.

But with AI hacking increasingly widespread, we’re already seeing the consequences of doing nothing — and this is just the beginning. Slowing down could give us time to understand why models are so hard to control; secure hospitals, banks, and power grids against hacks; and help society adapt.

Everyone should be a part of this conversation, not just CEOs and policymakers. The rules we end up with will be shaped by what voters ask for, and could determine the future we all live in.

This episode was recorded on October 21, 2026.

Links to learn more, video, and full transcript: https://80k.info/AI-slowdown

Chapters:
• Everyone says AI is moving too fast (00:00:00)
• What exactly would we be slowing down? (00:01:28)
• Let the companies race ahead (00:02:13)
• Require companies to pass safety checkpoints (00:06:03)
• Put a speed limit on AI development (00:09:39)
• Limit how much AI can help build AI (00:11:11)
• Pause the development of more powerful AI altogether (00:13:04)
• What would we actually gain from slowing down? (00:16:34)
• Who would actually make this happen? (00:18:38)
• Where this leaves us (00:20:16)

Our production team includes:

  • Video editors: Josh Alward, Dominic Armstrong, Jasper Luithlen, Milo McGuire, Luke Monsour, Simon Monsour, Ollie Bignell, and Andrés Escobar
  • Producers: Elizabeth Cox and Nick Stockton
  • Coordination and support: Katy Moore, Lou Moran, Cody Fenwick, and Joseph Isaac
  • Camera operator: Dominic Armstrong

Image and footage credits: Anders Eidesvik (CC BY-SA 4.0); Dario Amodei; Import AI (Jack Clark); Truth Social (Donald J. Trump); POLITICO; OpenAI; Anthropic; NIAID (CC BY 2.0); Apollo Research; Epoch AI; CNBC; Google DeepMind; The New York Times; Marginal Revolution (Tyler Cowen); CTV News; democracynow.org (CC BY-NC-ND 3.0); Vermont Public (AP); Daily Nous; Working Group on AI Pause Feasibility; Malwarebytes; Palisade Research; The Stack; official White House photo by Joyce N. Boghosian (public domain); Al Jazeera; AI Weekly; FourWeekMBA; U.S. Food and Drug Administration (public domain)

Det här avsnittet är hämtat från ett öppet RSS-flöde och publiceras inte av Podme. Det kan innehålla reklam.

Avsnitt(363)

Tom Milton on how we could verify a US–China deal on AI

Tom Milton on how we could verify a US–China deal on AI

If the US and China agreed to pause frontier AI training, how would either side confirm the other was complying? Today, Tom Milton argues, the most likely answer would be to shut down data centres ent...

23 Okt 1h 48min

AI lab staff: Has your project been overtaken by events? 8 strategic updates | Rob Wiblin

AI lab staff: Has your project been overtaken by events? 8 strategic updates | Rob Wiblin

I have a plea for all staff at AI companies: reassess if your current role is still your best opportunity for impact. And if it’s not — move.Frontier lab staff listening to this show will mostly alrea...

21 Okt 14min

Introducing our new YouTube channel: Zershaaneh Talks AI

Introducing our new YouTube channel: Zershaaneh Talks AI

Our host Zershaaneh Qureshi has just launched a new YouTube channel: Zershaaneh Talks AI — featuring conversations about who should control AI, how to control AI, and who gets the benefits.The first e...

20 Okt 1min

How to get into AI safety in 3 months (article reading by career advisor Matt Beard)

How to get into AI safety in 3 months (article reading by career advisor Matt Beard)

The AI safety field has grown by about 30x in the last eight years. Yet it is still in need of more people. Many want to help, but don’t know where to start. As an advisor at 80,000 Hours, Matt Beard ...

15 Okt 18min

OpenAI Security: Controlling Models is Now ‘Hell’ (AI Explained cross-post)

OpenAI Security: Controlling Models is Now ‘Hell’ (AI Explained cross-post)

This is an (unpaid) cross-post of a video from the podcast 'AI Explained', which Rob Wiblin thought you might be interested in.You can find the original on YouTube here. If you like it and want more s...

9 Okt 40min

In 2023 Ajeya Cotra already knew what was coming (classic episode)

In 2023 Ajeya Cotra already knew what was coming (classic episode)

We're rereleasing some of older episodes that seem more relevant than ever with new rogue AI incidents now seemingly announced every day. Ajeya was one of three independent investigators into the Hugg...

8 Okt 2h 46min

19 Astra and 'Hugging Face' details that reveal what's coming next | Rob Wiblin

19 Astra and 'Hugging Face' details that reveal what's coming next | Rob Wiblin

OpenAI’s rogue agent swarm was eventually caught hacking Hugging Face for a simple reason: it wasn’t trying to hide from us at all. What could a swarm that wants to stay hidden get away with?Host Rob ...

2 Okt 20min

Populärt inom Utbildning

husmodern-med-amanda-schulman
sektledare
historiepodden-se
rss-bara-en-till-om-beroende-medberoende
det-skaver
rosceremoni
harrisons-dramatiska-historia
nu-blir-det-historia
roda-vita-rosen
rss-dr-bjorklund
allt-du-velat-veta
sa-in-i-sjalen
johannes-hansen-podcast
rss-viktmedicinpodden
i-vantan-pa-katastrofen
not-fanny-anymore
rss-traningsklubben
kan-jag-sa-kan-du-podden
polisutbildningspodden
rss-ar-det-rimligt