119. Jaime Sevilla - Projecting AI progress from compute trends

119. Jaime Sevilla - Projecting AI progress from compute trends

There’s an idea in machine learning that most of the progress we see in AI doesn’t come from new algorithms of model architectures. instead, some argue, progress almost entirely comes from scaling up compute power, datasets and model sizes — and besides those three ingredients, nothing else really matters.

Through that lens the history of AI becomes the history f processing power and compute budgets. And if that turns out to be true, then we might be able to do a decent job of predicting AI progress by studying trends in compute power and their impact on AI development.

And that’s why I wanted to talk to Jaime Sevilla, an independent researcher and AI forecaster, and affiliate researcher at Cambridge University’s Centre for the Study of Existential Risk, where he works on technological forecasting and understanding trends in AI in particular. His work’s been cited in a lot of cool places, including Our World In Data, who used his team’s data to put together an exposé on trends in compute. Jaime joined me to talk about compute trends and AI forecasting on this episode of the TDS podcast.

***

Intro music:

- Artist: Ron Gelinas

- Track Title: Daybreak Chill Blend (original mix)

- Link to Track: https://youtu.be/d8Y2sKIgFWc

***

Chapters:

  • 2:00 Trends in compute
  • 4:30 Transformative AI
  • 13:00 Industrial applications
  • 19:00 GPT-3 and scaling
  • 25:00 The two papers
  • 33:00 Biological anchors
  • 39:00 Timing of projects
  • 43:00 The trade-off
  • 47:45 Wrap-up

Det här avsnittet är hämtat från ett öppet RSS-flöde och publiceras inte av Podme. Det kan innehålla reklam.

Avsnitt(130)

130. Edouard Harris - New Research: Advanced AI may tend to seek power *by default*

130. Edouard Harris - New Research: Advanced AI may tend to seek power *by default*

Progress in AI has been accelerating dramatically in recent years, and even months. It seems like every other day, there’s a new, previously-believed-to-be-impossible feat of AI that’s achieved by a w...

12 Okt 202258min

129. Amber Teng - Building apps with a new generation of language models

129. Amber Teng - Building apps with a new generation of language models

It’s no secret that a new generation of powerful and highly scaled language models is taking the world by storm. Companies like OpenAI, AI21Labs, and Cohere have built models so versatile that they’re...

5 Okt 202251min

128. David Hirko - AI observability and data as a cybersecurity weakness

128. David Hirko - AI observability and data as a cybersecurity weakness

Imagine you’re a big hedge fund, and you want to go out and buy yourself some data. Data is really valuable for you — it’s literally going to shape your investment decisions and determine your outcome...

28 Sep 202249min

127. Matthew Stewart - The emerging world of ML sensors

127. Matthew Stewart - The emerging world of ML sensors

Today, we live in the era of AI scaling. It seems like everywhere you look people are pushing to make large language models larger, or more multi-modal and leveraging ungodly amounts of processing pow...

21 Sep 202241min

126. JR King - Does the brain run on deep learning?

126. JR King - Does the brain run on deep learning?

Deep learning models — transformers in particular — are defining the cutting edge of AI today. They’re based on an architecture called an artificial neural network, as you probably already know if you...

14 Sep 202255min

125. Ryan Fedasiuk - Can the U.S. and China collaborate on AI safety?

125. Ryan Fedasiuk - Can the U.S. and China collaborate on AI safety?

It’s no secret that the US and China are geopolitical rivals. And it’s also no secret that that rivalry extends into AI — an area both countries consider to be strategically critical. But in a context...

7 Sep 202248min

124. Alex Watson - Synthetic data could change everything

124. Alex Watson - Synthetic data could change everything

There’s a website called thispersondoesnotexist.com. When you visit it, you’re confronted by a high-resolution, photorealistic AI-generated picture of a human face. As the website’s name suggests, the...

18 Maj 202251min

123. Ala Shaabana and Jacob Steeves - AI on the blockchain (it actually might just make sense)

123. Ala Shaabana and Jacob Steeves - AI on the blockchain (it actually might just make sense)

Two ML researchers with world-class pedigrees who decided to build a company that puts AI on the blockchain. Now to most people — myself included — “AI on the blockchain” sounds like a winning entry i...

12 Maj 202254min

Populärt inom Teknik

uppgang-och-fall
rss-laddstationen-med-elbilen-i-sverige
skogsforum-podcast
market-makers
bli-saker-podden
 och-bilen-gar-bra
elbilsveckan
rss-uppgang-och-fall
rss-en-ai-till-kaffet
developers-mer-an-bara-kod
rss-veckans-ai
natets-morka-sida
hej-bruksbil
rss-milpodden
rss-technokratin
solcellskollens-podcast
rss-upplyst-entreprenordirektor
rss-it-sakerhetspodden
ai-sweden-podcast
rss-fabriken-2