“Clarifying types of rogue AI activity: Breakout, breakin, exfiltration, … What’s what?” by Oliver Sourbut

In case you haven’t heard, the rogue AI agents are here. From an insider's perspective, the real news is that (rogue) AI is in the news — this is all stuff we’ve foreseen and been trying to warn people about for years.

I expect the new imperative on experts is not just to raise attention but to help explain the situation and offer nuance (while paying close attention to what we can learn from both new information and new perspectives, and staying alert to options for improving things).

With phrases like ‘rogue AI’ and ‘broke out of containment’ on the loose, perhaps it's time to distinguish some important types of rogue AI activity. Without this clarity, people end up talking past each other, and we might counterproductively overreact in some ways, and complacently underreact in others.

I’ll use the widely publicised Hugging Face swarm attack from Spring-Summer 2026 as a running example, as well as a few other comparison points. We’ll look at four key types of rogue activity. The first two have happened already: breaking in, and breaking out. The second two remain hypothetical but perhaps nearby: full escape, and insider infiltration. I won’t touch on why AI [...]

---

Outline:

(01:43) Type 1: Breaking In

(04:42) Type 2: Breaking Out

(08:20) Type 3: Full Escape/Self-Exfiltration

(13:03) Aside: Subsistence and maintenance

(14:17) Type 4: (Insider) Infiltration

(16:20) Wrapping up

The original text contained 12 footnotes which were omitted from this narration.

---

First published:
October 9th, 2026

Source:
https://forum.effectivealtruism.org/posts/DwDGbGBRiCfPpEvYQ/clarifying-types-of-rogue-ai-activity-breakout-breakin

---

Narrated by TYPE III AUDIO.

---

Images from the article:

Apple Podcasts and Spotify do not show images in the episode description. Try Pocket Casts, or another podcast app.