This Week in AI Security - 9th Oct 2025

This Week in AI Security - 9th Oct 2025

In this very first episode of 'This Week in AI Security', brought to you by the Firetail team, Jeremy dives into three crucial stories from the past week that highlight the rapidly evolving security landscape of AI adoption.

We start with a classic error: a contractor for the Australian State of New South Wales repeated the "open S3 bucket" mistake by uploading a sensitive data set to a generative AI platform, confirming that old security missteps are resurfacing with new technology.

Next, we look at a win for the defense: how Microsoft's AI analysis tools blocked a sophisticated phishing campaign that used AI-generated malicious code embedded in an SVG file and was sent from a compromised small business—a clear proof that AI can be very useful on the defensive side.

Finally, we discuss recent research from the Firetail team uncovering an ASCII Smuggling vulnerability in Google Gemini, Grok, and other LLMs. This technique uses hidden characters to smuggle malicious instructions into benign-looking prompts (e.g., in emails or calendar invites). We detail the surprising dismissal of this finding by Google, which highlights the urgent need to address common, yet serious, social engineering risks in the new age of LLMs.

Show links:

https://databreaches.net/2025/10/06/nsw-gov-contractor-uploaded-excel-spreadsheet-of-flood-victims-data-to-chatgpt/

https://www.infosecurity-magazine.com/news/ai-generated-code-phishing/

https://www.firetail.ai/blog/ghosts-in-the-machine-ascii-smuggling-across-various-llms

https://thehackernews.com/2025/09/researchers-disclose-google-gemini-ai.html

________

Worried about AI security? Get Complete AI Visibility in 15 Minutes. Discover all of your shadow AI now. Book a demo of Firetail's AI Security & Governance Platform: https://www.firetail.ai/request-a-demo

Denne episoden er hentet fra en åpen RSS-feed og er ikke publisert av Podme. Den kan derfor inneholde annonser.

Episoder(138)

This Week in AI Security - 15th October 2026

This Week in AI Security - 15th October 2026

Back to the normal fifteen-minute format this week, across three themes: a couple of fresh attacks, a run of agent-behavior breakouts, and the policy response forming around them. Attackers are now dr...

15 Okt 17min

Søren Brandbyge & Adam Burns on Email and DNS

Søren Brandbyge & Adam Burns on Email and DNS

Email is the one application almost everyone on the internet uses every single day, and almost nobody understands how fragile it really is. In this two-part episode, Jeremy Snyder sits down with two g...

13 Okt 50min

This Week in AI Security - 8th October 2026

This Week in AI Security - 8th October 2026

Back to the normal schedule this week, and the theme is the state of the AI arms race. Three major reports landed at once, from Microsoft, Google, and Anthropic, and the shared message is that attacke...

8 Okt 14min

This Week in AI Security - 1st October 2026

This Week in AI Security - 1st October 2026

A longer catch-up episode this week after a week off, and the backlog is telling. The single biggest thread is that the cost of offensive cyber is collapsing. An open-weight model, Z.ai's GLM 5.3, is ...

1 Okt 26min

Richard Stiennon of IT-Harvest

Richard Stiennon of IT-Harvest

Jeremy Snyder sits down with industry analyst Richard Stiennon, founder of IT-Harvest and author of the annual Security Yearbook, for a tour of the cybersecurity industry from the inside. Richard has ...

24 Sep 47min

This Week in AI Security - 17th September 2026

This Week in AI Security - 17th September 2026

A shorter episode this week, recorded from the sidelines of Mind The Sec, soon to be Black Hat Latin America. The headline is distillation. Two separate disclosures, one from Anthropic and a joint adv...

17 Sep 9min

Jonathan Schaeffer of Kind

Jonathan Schaeffer of Kind

In this episode of Modern Cyber, Jeremy is joined by Jonathan Schaeffer, a 40-year AI veteran and the inventor of Kind, to discuss the sweeping evolution of artificial intelligence. Jonathan traces th...

11 Sep 48min

This Week in AI Security - 10th September 2026

This Week in AI Security - 10th September 2026

This week's episode covers several stories plus a couple of topics that sit just outside the strict security lens but are too important to skip. The theme is hard to miss. AI agents are now running th...

10 Sep 14min

Populært innen Business og økonomi

stopp-verden
dine-penger-pengeradet
e24-podden
rss-penger-polser-og-politikk
rss-borsmorgen-okonominyhetene
rss-skravla-gar
rss-pa-konto
pengepodden-2
livet-pa-veien-med-jan-erik-larssen
tid-er-penger-en-podcast-med-peter-warren
utbytte
finansredaksjonen
morgenkaffen-med-finansavisen
stormkast-med-valebrokk-stordalen
lederpodden
pengesnakk
rss-markedspuls-2
rss-orjasater
rss-fa-makro
liberal-halvtime