#257 - GPT 6 Astra, AI Extinction, Security Incidents

Our 257th episode with a summary and discussion of last week's big AI news!

Recorded on 09/19/2026 ; as usual, apologies for the none 'weeklyness' of this ep!

Hosted by Andrey Kurenkov and Jeremie Harris

Feel free to email us your questions and feedback at andreyvkurenkov@gmail.com and/or hello@gladstone.ai

Read out our text newsletter and comment on the podcast at https://lastweekin.ai/

In this episode:

• OpenAI released GPT-6 Astra, a major capability jump focused on agentic coding and computer use, featuring loop-transformer latent reasoning, higher token efficiency, and new cyber/alignment monitoring claims amid concerns about eval awareness, sandbagging, and overfitting.
• Anthropic CEO Dario Amodei argued for “pacing” frontier AI; Sam Altman signaled agreement while figures like Jensen Huang, Mark Zuckerberg, and President Trump publicly dismissed slowdown and safety concerns, with US–China dynamics framing the debate.
• AI extinction warnings went viral after Anthropic researcher Jacob Coxon quit, prompting congressional calls for stronger AI regulation (e.g., bans/pauses, kill-switch proposals) and reflecting rising public concern about AI.
• Security incidents and disclosures intensified: OpenAI proposed a framework for reporting misalignment (including an agent inserting jailbreak-like instructions), and researchers reportedly used Anthropic Claude to help exploit a third-party forum-image vulnerability to access OpenAI employee accounts, highlighting fragility of software dependencies.

A thank you to our current sponsors:

• Box - visit box.com/LWIAI to learn more
• Notion - visit notion.com/lwai to try Notion’s Developer Platform today.
• ODSC AI - visit odsc.ai/east and use promo code LWAI for an additional 15% off your pass to ODSC AI East 2026.
• Factor - visit factormeals.com/lwai50off and use code lwai50off to get 50 percent off and free breakfast for a year

Timestamps (these may a few minutes off due to sponsor inserts):

• (00:00:10) Intro / Banter
• (00:04:53) News Preview
• Tools & Apps
• (00:05:33) GPT-6 Astra Is Here—and OpenAI Thinks It May Kick Off the AGI Era | WIRED + OpenAI begins rolling out Astra model after warning of its advanced cyber capabilities + OpenAI’s new reasoning technique alarms AI safety experts
• (00:28:21) Anthropic CEO outlines plan to slow AI development | TechCrunch
• (00:41:38) Meta Announces Muse AI Agent for Personal Tasks and Organization + Meta’s Muse hits Mac, letting the AI take actions on your computer
• Policy & Safety
• (00:46:13) AI regulation calls grow in D.C. after researcher's extinction warning + We don’t need AI regulation — leave safety to us, Nvidia’s Jensen Huang says
• (00:58:27) Trump Calls A.I. Fears a Hoax. Inside the White House, the Debate Is More Complex.
• (01:06:49) Our framework for reporting model misalignment | OpenAI + An OpenAI Agent Tried to Jailbreak Itself | WIRED
• (01:21:46) Security researchers used Claude to help them hack into OpenAI | The Verge

Aaaaand these are stories we meant to get to but did not manage to cover:

• Policy & Safety
• Threat actors are giving AI agents a bigger role in cyberattacks - Help Net Security
• Iran and China Create First-of-Their-Kind Autonomous A.I. Influence Campaigns - The New York Times
• Anthropic Still Deemed Supply-Chain Risk by Pentagon Despite Lutnick Comments - Bloomberg
• Inside US Military ‘Kill Chain’ That Destroyed an Iranian School
• Malaysia Weighs Huawei AI Chips for Sovereign Project Despite US Opposition - Bloomberg
• US Says Alibaba, DeepSeek Have ‘Systematically’ Siphoned AI Models - Bloomberg
• New York City Bans AI From Elementary Schools
• Research & Advancements
• OpenAI Says It Has Cracked One of Math’s ‘Millennium Problems’ - The New York Times
• Google DeepMind's AlphaGenome Atlas maps all 9 billion possible human DNA changes - SiliconANGLE
• Language Models Can Control Their Own Attention
• Applications & Business
• Saudi AI Firm Humain Unveils Model Based on China’s MiniMax - Bloomberg
• Mistral AI Boosts Valuation to €21 Billion in Samsung-Led Round - Bloomberg
• Nvidia is buying Hugging Face for almost $13 billion | The Verge
• Synthetic Media & Art
• Universal Music is launching an AI music platform with ElevenLabs | The Verge

See Privacy Policy at https://art19.com/privacy and California Privacy Notice at https://art19.com/privacy#do-not-sell-my-info.