ChinaTalk18 Feb 2024

AI at the Frontier: What it Takes to Compete

What does it take to train a frontier model? What's the know-how, the secret sauce that makes firms lets OpenAI and Deepmind push the limits of what's possible? How much are Chinese firms benefitting from western open source, and in the long term is it possible for western labs to maintain an edge? The hosts of the excellent Latent Space podcast, Alessio Fanelli of Decibel VC and Shawn Wang of Smol AI, come on to discuss. We get into: How the secret sauce used to push the frontier of AI diffuses out of the top labs and into substacks How labs are managing the culture change from quasi-academic outfits to places that have to ship How open source raises the global AI standard, but why there's likely to always be a gap between closed and open source China as a "GPU Poor" nation Three key algorithmic innovations that could reshape the balance of power between the GPU rich and GPU poor Outtro music: CHEKI https://open.spotify.com/track/1zKL2bOEkMDGuIjLhG34YA?si=9a713a88aa3d4f71 Cover photo: "Inkstand with A Madman Distilling His Brains" 1600s Urbino. Kind of like training a model! https://www.metmuseum.org/art/collection/search/188899 The met description: In this whimsical maiolica sculpture, a well-dressed man leans forward in his seat with his head in a covered pot set above a fiery hearth. The vessel beside the hearth almost certainly held ink. The man’s actions are explained by an inscription on the chair: "I distill my brain and am totally happy." Thus the task of the writer is equated with distillation—the process through which a liquid is purified by heating and cooling, extracting its essence. Learn more about your ad choices. Visit megaphone.fm/adchoices

Det här avsnittet är hämtat från ett öppet RSS-flöde och publiceras inte av Podme. Det kan innehålla reklam.

Avsnitt(578)

Drone Dominance | Travis Metz - DIU Acting Director

He was recently promoted to DIU’s acting director after spending the past year running the Drone Dominance Program. Co-hosting are Brian Clark, senior fellow at Hudson Institute and a retired submarin...

17 Okt 1h 22min

Why a Chinese AI Lab’s Product Lead Thinks AGI is “Inevitable” | Richard Bian

Richard Bian is the head of product operations for Ant Ling, the foundational LLM at Ant. If you don’t know Ant, they most famously make Alipay, which makes your money and your world run when you’re i...

16 Okt 1h 13min

From Posting to Policy: Saif Khan on DUV and the AI Balance

Saif Khan makes his ChinaTalk debut. He is perhaps my favorite example of posting-to-policy that I’ve seen over the course of my time following Washington. Saif wrote some truly excellent deep dives i...

15 Okt 59min

Matt Yglesias + Jerusalem Demsas + Jordan Crossover Pod

I join Matt and Jerusalem for an unhinged conversation (most entertaining of the year?) about China, AI, corruption, politics, and various other things. Check out their show The Argument, it's good. ...

12 Okt 1h 7min

AGI Believers: Kevin Roose on the Race

Kevin Roose, formerly of the New York Times and Hard Fork, joins ChinaTalk to discuss AGI Chronicles, his new history of OpenAI, Anthropic, DeepMind, and the people who believed in AGI long before it ...

8 Okt 1h 10min

Data is the Hard Part | Building AI Tools for the Military

Everyone wants AI that wins wars. Very few people want to collect, label, store, and test the data it runs on. Bharat Patel is currently Accenture’s AI and data lead for its defense portfolio, a form...

6 Okt 42min

WarTalk: AutoWarCom + Project Meridian

It's a new fiscal year with no new budget, and the Pentagon has a fresh batch of proposals. Two stand out: a four-star Autonomous Warfare Command, built to buy and field autonomous weapons fast, and P...

5 Okt 55min

Section 301 and the Spice Man who Sued Trump Over Them

In February, the Supreme Court ruled Trump's IEEPA tariffs illegal. So why is everyone still paying them? Because the administration rebuilt them: first under Section 122, then under Section 301, and ...

2 Okt 1h 5min