Why a Nation Can't Outsource Its Frontier AI - Alistair Pullen (Cosine AI)

Why a Nation Can't Outsource Its Frontier AI - Alistair Pullen (Cosine AI)

This episode is sponsored by Notion. Learn more about Notion's Developer Platform today at https://notion.com/mlst


Britain's most capable coding model can't be exported, and that ban is the whole reason Cosine set out to build one from scratch. Alistair Pullen, CEO and co-founder of Cosine, sits down with Tim Scarfe to explain how a frontier system he calls Fable, locked behind US export controls, became the founding case for a UK sovereign model trained on the Isambard supercomputer in Bristol.


The bet underneath it is economic. Pullen argues that an inference company, rather than a training-first lab, doesn't need billions to compete: millions, a national compute allocation, and a consortium feedback loop can be enough. From there it gets into the machinery, why open-weight models still trail the frontier on size, active parameters and data, the mixture-of-experts versus dense trade-off and why active params dominate how a model actually feels, and the edge that real coding trajectories confer.


The back half is about making agents trustworthy. Pullen makes the case for beating "slop" by rewarding the process instead of the final answer, reframes code review as runtime proof (spin the bug up in a VM and force the agent to actually exploit it), and walks through Swarm, Cosine's system running hundreds of sub-agents in one shot. It ends on why memory is still an unsolved hack, how synthetic graders let you run RL on tasks with no built-in test, and why Pullen reads US export controls as an accidental gift, with a supply-chain sting in the tail.


---

TIMESTAMPS:

00:00:00 The sovereign mandate and the Fable ban

00:04:02 Millions vs billions: the inference-company model

00:07:19 The consortium feedback loop

00:07:40 Why open models lag the frontier

00:14:59 MoE vs dense, and why active params matter

00:16:29 Trajectories: the process-data advantage

00:19:48 Beating slop: reward the process, not the answer

00:26:06 Reusable abstractions and the epistemic wall

00:29:56 Code review becomes runtime proof

00:37:32 Do agentic harnesses still matter?

00:40:35 Swarm: orchestrating hundreds of sub-agents

00:45:14 Why memory is still unsolved

00:48:25 Synthetic data and graders for RL

00:53:09 The US export gift and supply-chain risk


---

REFERENCES:

organization:

[00:01:15] Cosine

https://cosine.sh

[00:04:14] Mistral AI

https://mistral.ai

[00:05:50] Anthropic

https://www.anthropic.com

[00:07:42] Cohere

https://cohere.com

[00:08:36] DeepSeek

https://www.deepseek.com

tool:

[00:02:52] Isambard-AI

https://isambard.ac.uk

[00:05:56] Colossus (xAI)

https://en.wikipedia.org/wiki/Colossus_(supercomputer)

[00:07:52] GLM (Z.ai)

https://z.ai

[00:11:52] NVIDIA B300

https://www.nvidia.com/en-us/data-center/dgx-b300/

[00:15:37] gpt-oss-120b

https://huggingface.co/openai/gpt-oss-120b

[00:15:52] Devstral 2

https://mistral.ai/news/devstral

[00:16:01] Llama 70b

https://www.llama.com

[00:17:05] Claude Code

https://www.anthropic.com/claude-code

[00:26:23] ARC-AGI (Francois Chollet)

https://arcprize.org

[00:40:38] Swarm (Cosine)

https://cosine.sh

[00:40:50] OpenAI Codex

https://github.com/openai/codex

[00:41:16] Lumen Outpost (Cosine)

https://cosine.sh

[00:41:18] Kimi K2 (Moonshot)

https://huggingface.co/moonshotai/Kimi-K2-Instruct

[00:49:55] SWE-bench

https://www.swebench.com

[00:52:40] SystemVerilog

https://en.wikipedia.org/wiki/SystemVerilog

person:

[00:23:40] Andrej Karpathy

https://karpathy.ai

paper:

[00:27:10] GRPO (DeepSeekMath)

https://arxiv.org/abs/2402.03300

[00:27:13] GSPO

https://arxiv.org/abs/2507.18071


Incompressible Knowledge Probes, Bojie Li

https://arxiv.org/pdf/2604.24827


Estimating the Size of Claude Opus 4.5/4.6

https://unexcitedneurons.substack.com/p/estimating-the-size-of-claude-opus


---

ReScript:

https://app.rescript.info/session/5852d2b884c4ce4b?share=10b9799160845bb11779f8ac6cd3124f

Denne episoden er hentet fra en åpen RSS-feed og er ikke publisert av Podme. Den kan derfor inneholde annonser.

Episoder(271)

What Most People Get Wrong About Evolution | Akarsh Kumar

What Most People Get Wrong About Evolution | Akarsh Kumar

A lot of people in AI treat evolution as a dumb fallback, basically random search for when you can't take a gradient. Akarsh Kumar thinks that is wrong. Selection hangs on to partial solutions, so mut...

10 Okt 47min

How a Voice Agent Learns the Rhythm of Conversation — Shawn Wen

How a Voice Agent Learns the Rhythm of Conversation — Shawn Wen

Tsung-Hsien (Shawn) Wen, CTO of PolyAI, tells Tim Scarfe why voice agents are harder than text agents. Voice adds time, and a good conversation depends on adapting to the person on the line, not just ...

1 Okt 1h 10min

Who Checks a Proof No Human Can Read? — Leo de Moura

Who Checks a Proof No Human Can Read? — Leo de Moura

Leonardo de Moura created Lean and co-created Z3. ---This episode is sponsored by Parallel.Parallel, where agents find answers: web search, extraction and deep research APIs built for AI agents.Start ...

30 Sep 1h 14min

When AI Research Starts Moving Faster Than Human Research - Zhengyao Jiang

When AI Research Starts Moving Faster Than Human Research - Zhengyao Jiang

Weco let an AI coding agent rewrite the harness around another agent for eight days: its code, prompts and tools, while the underlying language model stayed fixed. Tim Scarfe asks Weco co-founder Zhen...

26 Sep 43min

How Deep Learning Finally Cracked Messy Tables - Frank Hutter

How Deep Learning Finally Cracked Messy Tables - Frank Hutter

Frank Hutter, co-founder of Prior Labs, talks about TabPFN, a tabular foundation model that makes predictions in a single forward pass, and the research behind it.TabPFN is pre-trained on synthetic da...

23 Sep 1h 53min

Why Scaling Prediction Cannot Create Intelligence - Alexander Mattick

Why Scaling Prediction Cannot Create Intelligence - Alexander Mattick

Alexander Mattick is a researcher at Fraunhofer IIS and a PhD researcher at the University of Technology Nuremberg (UTN), and a regular on Yannic Kilcher's Discord. He first came on MLST in 2022, afte...

21 Sep 2h 14min

How Physical AI Learns Across Language, Video and Action — Ming-Yu Liu

How Physical AI Learns Across Language, Video and Action — Ming-Yu Liu

The car making a left turn at the start of this episode was never filmed. Cosmos 3 generated it. Ming-Yu Liu, who leads the Cosmos research at NVIDIA, explains how one model can describe a video, gene...

15 Sep 25min

Speech Recognition Is Not a Solved Problem — Pavan Kumar Reddy

Speech Recognition Is Not a Solved Problem — Pavan Kumar Reddy

Pavan Kumar Reddy leads audio research at Mistral AI. He joins Tim Scarfe for a deep technical tour of Voxtral — and explains why the frontier of deployed voice is still a cascade of specialised model...

14 Sep 1h 42min

Populært innen Teknologi

teknisk-sett
energi-og-klima
lydartikler-fra-aftenposten
nasjonal-sikkerhetsmyndighet-nsm
elektropodden
tomprat-med-gunnar-tjomlid
rss-ai-forklart
rss-kunstig-intelligens-med-elisabeth-maren-og-morten
shifter
smart-forklart
fornybaren
pedagogisk-intelligens
rss-alt-som-gar-pa-strom
rss-bak-skyen
rss-alt-vi-kan
teknologimagasinet-aftenposten
rss-hvorfor-ble-det-sann
rss-romnasjonen
kortslutning
rss-ki-praten