This Week in AI Security - 6th November 2025

This Week in AI Security - 6th November 2025

In this week's episode, Jeremy looks at three compelling stories and a significant academic paper that illustrate the accelerating convergence of AI, APIs, and network security.

API Exposure in AI Services: We discuss a path traversal vulnerability that led to the discovery of 3,000 API keys in a managed AI hosting service, underscoring that the API remains the exposed attack surface where data exfiltration occurs.

AI Code Agent Traffic Analysis: Drawing on research from Chaser Systems, Jeremy breaks down the network traffic from popular AI coding agents (like Copilot and Cursor). The analysis reveals that sensitive data, including previous conversation context and PII, is repeatedly packaged and resent with every subsequent request, making detection and leakage risk significantly higher.

LLM-Powered Malware: We cover a groundbreaking discovery by the Microsoft Incident Response Team (DART): malware using the OpenAI Assistants API as its Command and Control (C2) server. This new category of malware replaces traditional hard-coded instructions with an LLM-driven "brain," giving it the potential to coordinate malicious activity with context, creativity, and adaptability.

The Guardrail Fallacy: Finally, Jeremy discusses an academic paper showing that strong, adaptive attacks can bypass LLM defenses against Jailbreaks and Prompt Injections with an Attack Success Rate (ASR) of over 90%. The research argues that simple guardrails provide organizations with a dangerous false sense of security.

Episode Links

https://chasersystems.com/blog/what-data-do-coding-agents-send-and-where-to/

https://embracethered.com/blog/posts/2025/claude-abusing-network-access-and-anthropic-api-for-data-exfiltration/

https://arxiv.org/pdf/2510.09023

https://www.microsoft.com/en-us/security/blog/2025/11/03/sesameop-novel-backdoor-uses-openai-assistants-api-for-command-and-control/

------

Worried about AI security? Get Complete AI Visibility in 15 Minutes. Discover all of your shadow AI now. Book a demo of Firetail's AI Security & Governance Platform: https://www.firetail.ai/request-a-demo

Det här avsnittet är hämtat från ett öppet RSS-flöde och publiceras inte av Podme. Det kan innehålla reklam.

Avsnitt(129)

This Week in AI Security - 27th August 2026

This Week in AI Security - 27th August 2026

Recorded from the sidelines of the AI Readiness Summit hosted by our partners at GMI, this week's episode runs through six security stories plus a Chatham House style recap of what practitioners in th...

27 Aug 15min

This Week in AI Security - 20th August 2026

This Week in AI Security - 20th August 2026

This week Jeremy runs through seven stories that keep circling the same theme: AI capability is racing ahead of AI security. From zero-click agent hijacking in agentic browsers, to a one-click Copilot...

27 Aug 18min

David Kerber of Act Security

David Kerber of Act Security

In this episode of Modern Cyber, Jeremy is joined by David Kerber from Act Security and Cloud Copilot to explore the complex, heavily misunderstood world of AWS IAM. David dismantles common misconcept...

18 Aug 37min

This Week in AI Security - 13th August 2026

This Week in AI Security - 13th August 2026

Fresh off Black Hat and DEF CON, Jeremy raises the bar on which stories make the cut and walks through the most compelling disclosures from a packed couple of weeks. The dominant theme: agents pursuin...

13 Aug 15min

This Week in AI Security - 6th August 2026

This Week in AI Security - 6th August 2026

Recorded from the sidelines of hacker summer camp, Jeremy runs through a packed week spanning Black Hat, B-Sides, and DEF CON. The theme keeps repeating: prompt injection is always possible, and it is...

6 Aug 21min

This Week in AI Security - 30th July 2026

This Week in AI Security - 30th July 2026

The final episode before Black Hat, and Jeremy keeps it tight with a few quick hits before settling into the week's biggest theme: identity, visibility, and the open-versus-closed model debate. This w...

30 Juli 17min

This Week in AI Security - 23rd July 2026

This Week in AI Security - 23rd July 2026

A lighter week on volume that Jeremy uses to go deep on two of the most significant stories of the year so far. The episode opens with quick hits on export-control pressure spreading to OpenAI's model...

23 Juli 23min

This Week in AI Security - 16th July 2026

This Week in AI Security - 16th July 2026

Another lighter week that lets Jeremy slow down and dig into the stories that matter most. The theme running through this episode: the tooling and plumbing around AI keep proving to be the real attack...

16 Juli 15min

Populärt inom Business & ekonomi

framgangspodden
rss-jossan-nina
varvet
badfluence
rss-borsens-finest
avanzapodden
svd-tech-brief
uppgang-och-fall
rss-inga-dumma-fragor-om-pengar
fill-or-kill
lastbilspodden
tabberaset
24fragor
bathina-en-podcast
skaraborgspodden
rikatillsammans-om-privatekonomi-rikedom-i-livet
borsmorgon
rss-hos-psykologen
rss-dagen-med-di
rss-kort-lang-analyspodden-fran-di