Can AIs already start 'rogue deployments' inside AI companies? (Landmark new METR report)

Can AIs already start 'rogue deployments' inside AI companies? (Landmark new METR report)

A red-teamer was embedded inside Anthropic for three weeks, told to imagine he was an evil Claude, and asked to figure out how to launch a ‘rogue AI deployment’ without getting caught. It’s one part of a landmark report released yesterday by METR — the outfit behind the task-completion time horizon graph which has become the single most watched measure of AI progress.


This major new research push is being conducted with close collaboration from OpenAI, Google DeepMind, Meta, and Anthropic, and led by METR researchers Hjalmar Wijk and Ajeya Cotra. It represents the first systematic study of what newly trained AI models could get away with inside the companies that built them, before anyone outside the company even knows they exist.

The conclusion: AI models now have the means, the motive, and the opportunity to start “minimal rogue deployments” in pursuit of their own independent goals, like acquiring more compute, at all four companies studied.

David Rein, the red-teamer placed inside Anthropic, identified a number of weaknesses models could exploit there: expansive permissions, cloud jobs outside of monitoring, and monitors that are trivial to jailbreak. But he also found that frontier models were comically bad at key parts of the process, which means they can’t cause meaningful damage for now.

In this video, Rob Wiblin reconciles the conflicting picture and looks forward to METR’s second round of stress tests. They’ll begin in just a few months, a necessary move with AI advancing so quickly.

This episode was recorded on May 15, 2026.

Learn more, video, and full transcript: https://80k.info/metr-report

Chapters:

  • What could an unreleased AI get away with? – the new METR report (00:00:00)
  • Motive: Why grab more compute? (00:01:54)
  • Opportunity: YOLO mode and jailbreaks (00:05:46)
  • Means: Brilliant idiots in data centres (00:11:02)
  • We have to test unreleased models (00:15:45)
  • Especially if AI R&D is coming in 2028 (00:18:30)

Video and audio editing: Dominic Armstrong, Milo McGuire, Luke Monsour, and Josh Alward
Camera operator: Dominic Armstrong
Production: Elizabeth Cox, Nick Stockton, and Katy Moore

Det här avsnittet är hämtat från ett öppet RSS-flöde och publiceras inte av Podme. Det kan innehålla reklam.

Avsnitt(364)

Luke Muehlhauser on the most important AI safety work nobody is doing

Luke Muehlhauser on the most important AI safety work nobody is doing

The US government spends 25 times more on military marching bands than on its AI safety institute. And that’s just one of the many institutions we’re missing as AI becomes more powerful and dangerous....

29 Okt 2h 36min

Why Silicon Valley can’t slow down AI on its own | Luisa Rodriguez

Why Silicon Valley can’t slow down AI on its own | Luisa Rodriguez

Two-thirds of Americans think AI is moving too fast. So do the people building it. So why the hell isn’t anyone slowing down?We can’t tell when models are too dangerous. We mostly don’t know how they ...

27 Okt 21min

Tom Milton on how we could verify a US–China deal on AI

Tom Milton on how we could verify a US–China deal on AI

If the US and China agreed to pause frontier AI training, how would either side confirm the other was complying? Today, Tom Milton argues, the most likely answer would be to shut down data centres ent...

23 Okt 1h 48min

AI lab staff: Has your project been overtaken by events? 8 strategic updates | Rob Wiblin

AI lab staff: Has your project been overtaken by events? 8 strategic updates | Rob Wiblin

I have a plea for all staff at AI companies: reassess if your current role is still your best opportunity for impact. And if it’s not — move.Frontier lab staff listening to this show will mostly alrea...

21 Okt 14min

Introducing our new YouTube channel: Zershaaneh Talks AI

Introducing our new YouTube channel: Zershaaneh Talks AI

Our host Zershaaneh Qureshi has just launched a new YouTube channel: Zershaaneh Talks AI — featuring conversations about who should control AI, how to control AI, and who gets the benefits.The first e...

20 Okt 1min

How to get into AI safety in 3 months (article reading by career advisor Matt Beard)

How to get into AI safety in 3 months (article reading by career advisor Matt Beard)

The AI safety field has grown by about 30x in the last eight years. Yet it is still in need of more people. Many want to help, but don’t know where to start. As an advisor at 80,000 Hours, Matt Beard ...

15 Okt 18min

OpenAI Security: Controlling Models is Now ‘Hell’ (AI Explained cross-post)

OpenAI Security: Controlling Models is Now ‘Hell’ (AI Explained cross-post)

This is an (unpaid) cross-post of a video from the podcast 'AI Explained', which Rob Wiblin thought you might be interested in.You can find the original on YouTube here. If you like it and want more s...

9 Okt 40min

In 2023 Ajeya Cotra already knew what was coming (classic episode)

In 2023 Ajeya Cotra already knew what was coming (classic episode)

We're rereleasing some of older episodes that seem more relevant than ever with new rogue AI incidents now seemingly announced every day. Ajeya was one of three independent investigators into the Hugg...

8 Okt 2h 46min

Populärt inom Utbildning

husmodern-med-amanda-schulman
rss-bara-en-till-om-beroende-medberoende
historiepodden-se
det-skaver
rosceremoni
nu-blir-det-historia
harrisons-dramatiska-historia
sektledare
rss-dr-bjorklund
not-fanny-anymore
rss-viktmedicinpodden
allt-du-velat-veta
johannes-hansen-podcast
roda-vita-rosen
i-vantan-pa-katastrofen
sa-in-i-sjalen
rss-max-tant-med-max-villman
rss-foraldramotet-bring-lagercrantz
kan-jag-sa-kan-du-podden
sex-pa-riktigt-med-marika-smith