#78 – Danny Hernandez on forecasting and the drivers of AI progress

#78 – Danny Hernandez on forecasting and the drivers of AI progress

Companies use about 300,000 times more computation training the best AI systems today than they did in 2012 and algorithmic innovations have also made them 25 times more efficient at the same tasks.

These are the headline results of two recent papers — AI and Compute and AI and Efficiency — from the Foresight Team at OpenAI. In today's episode I spoke with one of the authors, Danny Hernandez, who joined OpenAI after helping develop better forecasting methods at Twitch and Open Philanthropy.

Danny and I talk about how to understand his team's results and what they mean (and don't mean) for how we should think about progress in AI going forward.

Links to learn more, summary and full transcript.

Debates around the future of AI can sometimes be pretty abstract and theoretical. Danny hopes that providing rigorous measurements of some of the inputs to AI progress so far can help us better understand what causes that progress, as well as ground debates about the future of AI in a better shared understanding of the field.

If this research sounds appealing, you might be interested in applying to join OpenAI's Foresight team — they're currently hiring research engineers.

In the interview, Danny and I (Arden Koehler) also discuss a range of other topics, including:
• The question of which experts to believe
• Danny's journey to working at OpenAI
• The usefulness of "decision boundaries"
• The importance of Moore's law for people who care about the long-term future
• What OpenAI's Foresight Team's findings might imply for policy
• The question whether progress in the performance of AI systems is linear
• The safety teams at OpenAI and who they're looking to hire
• One idea for finding someone to guide your learning
• The importance of hardware expertise for making a positive impact

Chapters:

  • Rob’s intro (00:00:00)
  • The interview begins (00:01:29)
  • Forecasting (00:07:11)
  • Improving the public conversation around AI (00:14:41)
  • Danny’s path to OpenAI (00:24:08)
  • Calibration training (00:27:18)
  • AI and Compute (00:45:22)
  • AI and Efficiency (01:09:22)
  • Safety teams at OpenAI (01:39:03)
  • Careers (01:49:46)
  • AI hardware as a possible path to impact (01:55:57)
  • Triggers for people’s major decisions (02:08:44)

Producer: Keiran Harris
Audio mastering: Ben Cordell
Transcriptions: Zakee Ulhaq

Jaksot(326)

#195 – Sella Nevo on who's trying to steal frontier AI models, and what they could do with them

#195 – Sella Nevo on who's trying to steal frontier AI models, and what they could do with them

"Computational systems have literally millions of physical and conceptual components, and around 98% of them are embedded into your infrastructure without you ever having heard of them. And an inordin...

1 Elo 20242h 8min

#194 – Vitalik Buterin on defensive acceleration and how to regulate AI when you fear government

#194 – Vitalik Buterin on defensive acceleration and how to regulate AI when you fear government

"If you’re a power that is an island and that goes by sea, then you’re more likely to do things like valuing freedom, being democratic, being pro-foreigner, being open-minded, being interested in trad...

26 Heinä 20243h 4min

#193 – Sihao Huang on navigating the geopolitics of US–China AI competition

#193 – Sihao Huang on navigating the geopolitics of US–China AI competition

"You don’t necessarily need world-leading compute to create highly risky AI systems. The biggest biological design tools right now, like AlphaFold’s, are orders of magnitude smaller in terms of comput...

18 Heinä 20242h 23min

#192 – Annie Jacobsen on what would happen if North Korea launched a nuclear weapon at the US

#192 – Annie Jacobsen on what would happen if North Korea launched a nuclear weapon at the US

"Ring one: total annihilation; no cellular life remains. Ring two, another three-mile diameter out: everything is ablaze. Ring three, another three or five miles out on every side: third-degree burns ...

12 Heinä 20241h 54min

#191 (Part 2) – Carl Shulman on government and society after AGI

#191 (Part 2) – Carl Shulman on government and society after AGI

This is the second part of our marathon interview with Carl Shulman. The first episode is on the economy and national security after AGI. You can listen to them in either order!If we develop artificia...

5 Heinä 20242h 20min

#191 (Part 1) – Carl Shulman on the economy and national security after AGI

#191 (Part 1) – Carl Shulman on the economy and national security after AGI

This is the first part of our marathon interview with Carl Shulman. The second episode is on government and society after AGI. You can listen to them in either order!The human brain does what it does ...

27 Kesä 20244h 14min

#190 – Eric Schwitzgebel on whether the US is conscious

#190 – Eric Schwitzgebel on whether the US is conscious

"One of the most amazing things about planet Earth is that there are complex bags of mostly water — you and me – and we can look up at the stars, and look into our brains, and try to grapple with the ...

7 Kesä 20242h

#189 – Rachel Glennerster on why we still don’t have vaccines that could save millions

#189 – Rachel Glennerster on why we still don’t have vaccines that could save millions

"You can’t charge what something is worth during a pandemic. So we estimated that the value of one course of COVID vaccine in January 2021 was over $5,000. They were selling for between $6 and $40. So...

29 Touko 20242h 48min

Suosittua kategoriassa Koulutus

rss-murhan-anatomia
voi-hyvin-meditaatiot-2
psykopodiaa-podcast
rss-narsisti
adhd-podi
rahapuhetta
rss-rahamania
kesken
psykologia
rss-liian-kuuma-peruna
rss-eron-alkemiaa
rss-arkea-ja-aurinkoa-podcast-espanjasta
rss-niinku-asia-on
rss-luonnollinen-synnytys-podcast
rss-vapaudu-voimaasi
ihminen-tavattavissa-tommy-hellsten-instituutti
rss-duodecim-lehti
rss-finnish-daily-dialogues
esa-saarinen-filosofia-ja-systeemiajattelu
rss-tietoinen-yhteys-podcast-2