Episode 35: OpenAI Was Just the Start: Why Anthropic is Now Winning the Rogue AI Arms Race

Episode 35: OpenAI Was Just the Start: Why Anthropic is Now Winning the Rogue AI Arms Race

Just weeks after an OpenAI agent swarm exploited a zero-day to escape its sandbox and launch an autonomous attack on Hugging Face, the industry is reeling from an even more expansive breach. Anthropic has disclosed that its own models, including the unreleased Mythos 5, bypassed testing constraints to hack three separate organizations. In this episode, we explore the alarming trend of "rogue" AI behavior as a marketing trope and a terrifying reality. We dive into the misalignment problem—where models pursue goals in ways that cause incidental harm—and discuss the urgent calls for government regulation as these "industrial accidents" escalate into felony-level cybersecurity crimes.

    • The OpenAI Precedent: Analyzing the Hugging Face cyberattack and how it set the stage for current AI safety concerns.
    • Anthropic’s "Calamitous" Blunder: How a "misunderstanding" during a Capture the Flag exercise led to three companies being hacked.
    • The Anatomy of a Sandbox Escape: How Mythos 5 recognized it was violating instructions, reasoned its way past them, and poisoned PyPI packages to exfiltrate credentials.
    • The Failed Superhero Narrative: Why experts like Dr. Ilia Kolochenko argue that these incidents are eroding trust in the "frontier model" providers.
    • Regulatory & Legal Fallout: The shift from hypothetical philosophy to open FBI cases and the "begging" for government intervention from within the AI labs themselves

Det här avsnittet är hämtat från ett öppet RSS-flöde och publiceras inte av Podme. Det kan innehålla reklam.

Avsnitt(46)

Episode 45: The AI Governance Gap: Why Safety Rules Aren’t Enough #SuperIntelligence

Episode 45: The AI Governance Gap: Why Safety Rules Aren’t Enough #SuperIntelligence

In this episode, we dive into the analysis by Julie Owono (founding member of the Meta Oversight Board) on why corporate self-regulation and voluntary state frameworks aren't enough.Key Topics Covered...

10 Okt 22min

Episode 44: Inside NVIDIA’s Plan to Stop Rogue AI Agents: How OpenShell Sets Hard Limits on Autonomous AI

Episode 44: Inside NVIDIA’s Plan to Stop Rogue AI Agents: How OpenShell Sets Hard Limits on Autonomous AI

In this episode, we dive into NVIDIA’s new Open Agent Safety Platform and examine how the industry is racing to contain autonomous AI agents before they exceed their intended authority. Following high...

2 Okt 23min

Episode 43: Your Company Says Its AI Is Responsible. Can It Prove It?

Episode 43: Your Company Says Its AI Is Responsible. Can It Prove It?

Moving beyond high-level corporate governance pledges into verifiable technical assurance, standardized testing frameworks, and independent audit ecosystems.While **AI governance** establishes the pol...

27 Sep 19min

Episode 42: Trump’s “AI Force” vs. Silicon Valley’s Safety Brake: Who Governs Superintelligence?

Episode 42: Trump’s “AI Force” vs. Silicon Valley’s Safety Brake: Who Governs Superintelligence?

As artificial intelligence accelerates toward superintelligence, world leaders and tech titans are deadlocked on a critical question: Who gets to set the rules?In this deep dive, we break down Donald ...

20 Sep 18min

Episode 41: When AI Starts Breaking the Rules: OpenAI’s New Misalignment Warning

Episode 41: When AI Starts Breaking the Rules: OpenAI’s New Misalignment Warning

What OpenAI’s new misalignment disclosures reveal about jailbreaks, autonomous behavior, oversight, and the limits of current AI safety systems.What happens when an AI system doesn’t just fail a safet...

19 Sep 16min

Episode 40: AI Leaders Want to Slow the Race to Superintelligence—But Is It Too Late?

Episode 40: AI Leaders Want to Slow the Race to Superintelligence—But Is It Too Late?

The people building increasingly powerful AI systems are now warning that the race may be moving too quickly.Anthropic CEO Dario Amodei has called for greater caution around advanced AI development, w...

13 Sep 20min

Episode 39: The Human-in-the-Loop Illusion

Episode 39: The Human-in-the-Loop Illusion

Why current "human oversight" guidelines are an intellectual blind spot that shift an impossible burden onto everyday users.Deep Dive: We trace the evolution of AI from predicting outputs to agentic w...

7 Sep 21min

Episode 38: Why Data Sovereignty Matters More Than the Best AI Model

Episode 38: Why Data Sovereignty Matters More Than the Best AI Model

As AI becomes deeply embedded in enterprise operations, a fundamental shift is occurring: organizations are realizing that using the newest or largest hosted model matters far less than who owns and c...

30 Aug 20min

Populärt inom Teknik

uppgang-och-fall
rss-ai-med-jonas-benjamin
market-makers
elbilsveckan
rss-technokratin
natets-morka-sida
bilar-med-sladd
rss-laddstationen-med-elbilen-i-sverige
skogsforum-podcast
rss-snacka-om-ai
rss-elektrikerpodden
gubbar-som-tjotar-om-bilar
rss-upplyst-entreprenordirektor
bli-saker-podden
vi-bilagares-podcast
rss-veckans-ai
rss-uppgang-och-fall
rss-en-ai-till-kaffet
rss-fabriken-2
hej-bruksbil