Modern Cyber with Jeremy Snyder9 Okt 2025

This Week in AI Security - 9th Oct 2025

In this very first episode of 'This Week in AI Security', brought to you by the Firetail team, Jeremy dives into three crucial stories from the past week that highlight the rapidly evolving security landscape of AI adoption.

We start with a classic error: a contractor for the Australian State of New South Wales repeated the "open S3 bucket" mistake by uploading a sensitive data set to a generative AI platform, confirming that old security missteps are resurfacing with new technology.

Next, we look at a win for the defense: how Microsoft's AI analysis tools blocked a sophisticated phishing campaign that used AI-generated malicious code embedded in an SVG file and was sent from a compromised small business—a clear proof that AI can be very useful on the defensive side.

Finally, we discuss recent research from the Firetail team uncovering an ASCII Smuggling vulnerability in Google Gemini, Grok, and other LLMs. This technique uses hidden characters to smuggle malicious instructions into benign-looking prompts (e.g., in emails or calendar invites). We detail the surprising dismissal of this finding by Google, which highlights the urgent need to address common, yet serious, social engineering risks in the new age of LLMs.

Show links:

https://databreaches.net/2025/10/06/nsw-gov-contractor-uploaded-excel-spreadsheet-of-flood-victims-data-to-chatgpt/

https://www.infosecurity-magazine.com/news/ai-generated-code-phishing/

https://www.firetail.ai/blog/ghosts-in-the-machine-ascii-smuggling-across-various-llms

https://thehackernews.com/2025/09/researchers-disclose-google-gemini-ai.html

________

Worried about AI security? Get Complete AI Visibility in 15 Minutes. Discover all of your shadow AI now. Book a demo of Firetail's AI Security & Governance Platform: https://www.firetail.ai/request-a-demo

Det här avsnittet är hämtat från ett öppet RSS-flöde och publiceras inte av Podme. Det kan innehålla reklam.

Avsnitt(129)

This Week in AI Security - 27th August 2026

Recorded from the sidelines of the AI Readiness Summit hosted by our partners at GMI, this week's episode runs through six security stories plus a Chatham House style recap of what practitioners in th...

27 Aug 15min

This Week in AI Security - 20th August 2026

This week Jeremy runs through seven stories that keep circling the same theme: AI capability is racing ahead of AI security. From zero-click agent hijacking in agentic browsers, to a one-click Copilot...

27 Aug 18min

David Kerber of Act Security

In this episode of Modern Cyber, Jeremy is joined by David Kerber from Act Security and Cloud Copilot to explore the complex, heavily misunderstood world of AWS IAM. David dismantles common misconcept...

18 Aug 37min

This Week in AI Security - 13th August 2026

Fresh off Black Hat and DEF CON, Jeremy raises the bar on which stories make the cut and walks through the most compelling disclosures from a packed couple of weeks. The dominant theme: agents pursuin...

13 Aug 15min

This Week in AI Security - 6th August 2026

Recorded from the sidelines of hacker summer camp, Jeremy runs through a packed week spanning Black Hat, B-Sides, and DEF CON. The theme keeps repeating: prompt injection is always possible, and it is...

6 Aug 21min

This Week in AI Security - 30th July 2026

The final episode before Black Hat, and Jeremy keeps it tight with a few quick hits before settling into the week's biggest theme: identity, visibility, and the open-versus-closed model debate. This w...

30 Juli 17min

This Week in AI Security - 23rd July 2026

A lighter week on volume that Jeremy uses to go deep on two of the most significant stories of the year so far. The episode opens with quick hits on export-control pressure spreading to OpenAI's model...

23 Juli 23min

This Week in AI Security - 16th July 2026

Another lighter week that lets Jeremy slow down and dig into the stories that matter most. The theme running through this episode: the tooling and plumbing around AI keep proving to be the real attack...

16 Juli 15min