ChinaTalk18 Feb 2024

AI at the Frontier: What it Takes to Compete

What does it take to train a frontier model? What's the know-how, the secret sauce that makes firms lets OpenAI and Deepmind push the limits of what's possible? How much are Chinese firms benefitting from western open source, and in the long term is it possible for western labs to maintain an edge? The hosts of the excellent Latent Space podcast, Alessio Fanelli of Decibel VC and Shawn Wang of Smol AI, come on to discuss. We get into: How the secret sauce used to push the frontier of AI diffuses out of the top labs and into substacks How labs are managing the culture change from quasi-academic outfits to places that have to ship How open source raises the global AI standard, but why there's likely to always be a gap between closed and open source China as a "GPU Poor" nation Three key algorithmic innovations that could reshape the balance of power between the GPU rich and GPU poor Outtro music: CHEKI https://open.spotify.com/track/1zKL2bOEkMDGuIjLhG34YA?si=9a713a88aa3d4f71 Cover photo: "Inkstand with A Madman Distilling His Brains" 1600s Urbino. Kind of like training a model! https://www.metmuseum.org/art/collection/search/188899 The met description: In this whimsical maiolica sculpture, a well-dressed man leans forward in his seat with his head in a covered pot set above a fiery hearth. The vessel beside the hearth almost certainly held ink. The man’s actions are explained by an inscription on the chair: "I distill my brain and am totally happy." Thus the task of the writer is equated with distillation—the process through which a liquid is purified by heating and cooling, extracting its essence. Learn more about your ad choices. Visit megaphone.fm/adchoices

Denne episoden er hentet fra en åpen RSS-feed og er ikke publisert av Podme. Den kan derfor inneholde annonser.

Episoder(551)

WarTalk: Odyssey Edition

Roel Konijnendijk of Oxford returns to talk Nolan's Odyssey, ancient PTSD, siege warfare, and the choices we'd all make in adapting. Justin McIntosh cohosts. YoungBoy Never Broke Again as well as ...

30 Jul 1h 28min

The Iran War Oil Shock That Wasn’t...(Yet?)

The biggest oil shock in modern history came and went without the catastrophe everyone expected. When Iran closed the Strait of Hormuz, analysts warned that oil could hit $200 a barrel, but the global...

26 Jul 1h 6min

WarTalk: Iran War Back On, Rogue AI, Ukraine Civ-Mil

Five months into the Iran campaign, the US has two carrier strike groups parked in the Arabian Sea, a blockade that may take months to bite, and a daisy chain of tankers stretching thousands of miles ...

24 Jul 1h 3min

Kimi K3, Xi's Speech, and China's Mythos Moment

The whole ChinaTalk gang gets together to discuss a big week in China AI with the release of Kimi K3 and Xi talking open source and safety at WAIC. We also discuss our latest article exploring the thr...

22 Jul 59min

WarTalk: Ancient Greece Edition!

What do actual historians think about the Thucydides Trap? Does our 'low T' discourse all just come back to the movie 300? How the did ancient Greeks fight and why does Homer still keep us coming bac...

21 Jul 2h

China's Mythos Moment

Claude Mythos scrambled American AI policy, leaving us with what Dean Ball calls a de facto involuntary licensing regime from the administration that promised us the opposite. Zhipu's cofounder says C...

15 Jul 1h 10min

WarTalk: Iran + Randy Schriver on Asian Defense

Beijing just announced a persistent Coast Guard patrol east of Taiwan, the administration is calling arms sales a "bargaining chip," and the NDS doesn't mention Taiwan at all. Is deterrence in the Str...

10 Jul 1h 2min

The Chemicals Powering the Chip Industry

We cover: How the Iran War has exposed vulnerabilities in the semiconductor industry’s chemical supply chains. The chemistry behind chip manufacturing — why advanced semiconductors depend o...

7 Jul 1h 18min