#94 – Ilya Sutskever: Deep Learning
Lex Fridman Podcast8 Maj 2020

#94 – Ilya Sutskever: Deep Learning

Ilya Sutskever is the co-founder of OpenAI, is one of the most cited computer scientist in history with over 165,000 citations, and to me, is one of the most brilliant and insightful minds ever in the field of deep learning. There are very few people in this world who I would rather talk to and brainstorm with about deep learning, intelligence, and life than Ilya, on and off the mic.

Support this podcast by signing up with these sponsors:
– Cash App – use code “LexPodcast” and download:
– Cash App (App Store): https://apple.co/2sPrUHe
– Cash App (Google Play): https://bit.ly/2MlvP5w

EPISODE LINKS:
Ilya’s Twitter: https://twitter.com/ilyasut
Ilya’s Website: https://www.cs.toronto.edu/~ilya/

This conversation is part of the Artificial Intelligence podcast. If you would like to get more information about this podcast go to https://lexfridman.com/ai or connect with @lexfridman on Twitter, LinkedIn, Facebook, Medium, or YouTube where you can watch the video versions of these conversations. If you enjoy the podcast, please rate it 5 stars on Apple Podcasts, follow on Spotify, or support it on Patreon.

Here’s the outline of the episode. On some podcast players you should be able to click the timestamp to jump to that time.

OUTLINE:
00:00 – Introduction
02:23 – AlexNet paper and the ImageNet moment
08:33 – Cost functions
13:39 – Recurrent neural networks
16:19 – Key ideas that led to success of deep learning
19:57 – What’s harder to solve: language or vision?
29:35 – We’re massively underestimating deep learning
36:04 – Deep double descent
41:20 – Backpropagation
42:42 – Can neural networks be made to reason?
50:35 – Long-term memory
56:37 – Language models
1:00:35 – GPT-2
1:07:14 – Active learning
1:08:52 – Staged release of AI systems
1:13:41 – How to build AGI?
1:25:00 – Question to AGI
1:32:07 – Meaning of life

Avsnitt(495)

#470 – James Holland: World War II, Hitler, Churchill, Stalin & Biggest Battles

#470 – James Holland: World War II, Hitler, Churchill, Stalin & Biggest Battles

James Holland is a historian specializing in World War II. He hosts a podcast called WW2 Pod: We Have Ways of Making You Talk. Thank you for listening ❤ Check out our sponsors: https://lexfridman.com/...

24 Maj 20253h 30min

#469 – Oliver Anthony: Country Music, Blue-Collar America, Fame, Money, and Pain

#469 – Oliver Anthony: Country Music, Blue-Collar America, Fame, Money, and Pain

Oliver Anthony is singer-songwriter who first gained worldwide fame with his viral hit Rich Men North of Richmond. He became a voice for many who are voiceless, with many of his songs speaking to the ...

20 Maj 20252h 27min

#468 – Janna Levin: Black Holes, Wormholes, Aliens, Paradoxes & Extra Dimensions

#468 – Janna Levin: Black Holes, Wormholes, Aliens, Paradoxes & Extra Dimensions

Janna Levin is a theoretical physicist and cosmologist specializing in black holes, cosmology of extra dimensions, topology of the universe, and gravitational waves. Thank you for listening ❤ Check ou...

5 Maj 20253h 7min

#467 – Tim Sweeney: Fortnite, Unreal Engine, and the Future of Gaming

#467 – Tim Sweeney: Fortnite, Unreal Engine, and the Future of Gaming

Tim Sweeney is a legendary video game programmer, founder and CEO of Epic Games that created the Unreal Engine, Fortnite, Gears of War, Unreal Tournament, and many other groundbreaking and influential...

30 Apr 20250s

#466 – Jeffrey Wasserstrom: China, Xi Jinping, Trade War, Taiwan, Hong Kong, Mao

#466 – Jeffrey Wasserstrom: China, Xi Jinping, Trade War, Taiwan, Hong Kong, Mao

Jeffrey Wasserstrom is a historian of modern China. Thank you for listening ❤ Check out our sponsors: https://lexfridman.com/sponsors/ep466-sc See below for timestamps, transcript, and to give feedbac...

24 Apr 20253h 14min

#465 – Robert Rodriguez: Sin City, Desperado, El Mariachi, Alita, and Filmmaking

#465 – Robert Rodriguez: Sin City, Desperado, El Mariachi, Alita, and Filmmaking

Robert Rodriguez is a legendary filmmaker and creator of Sin City, El Mariachi, Desperado, Spy Kids, Machete, From Dusk Till Dawn, Alita: Battle Angel, The Faculty, and his newest venture Brass Knuckl...

17 Apr 20253h 35min

#464 – Dave Smith: Israel, Ukraine, Epstein, Mossad, Conspiracies & Antisemitism

#464 – Dave Smith: Israel, Ukraine, Epstein, Mossad, Conspiracies & Antisemitism

Dave Smith is a comedian, libertarian, political commentator, and the host of Part of the Problem podcast. Thank you for listening ❤ Check out our sponsors: https://lexfridman.com/sponsors/ep464-sc Se...

9 Apr 20253h 26min

#463 – Douglas Murray: Putin, Zelenskyy, Trump, Israel, Netanyahu, Hamas & Gaza

#463 – Douglas Murray: Putin, Zelenskyy, Trump, Israel, Netanyahu, Hamas & Gaza

Douglas Murray is the author of On Democracies and Death Cults, The War on The West, and The Madness of Crowds. Thank you for listening ❤ Check out our sponsors: https://lexfridman.com/sponsors/ep463-...

30 Mars 20253h 16min

Populärt inom Vetenskap

svd-nyhetsartiklar
dumma-manniskor
p3-dystopia
kapitalet-en-podd-om-ekonomi
allt-du-velat-veta
doden-hjarnan-kemisten
rss-ufo-bortom-rimligt-tvivel-2
rss-vetenskapsradion-2
rss-vetenskapsradion
det-morka-psyket
sexet
bildningspodden
medicinvetarna
paranormalt-med-caroline-giertz
rss-spraket
rss-experimentet
har-vi-akt-till-mars-an
dumforklarat
rss-odla
rss-tidsmaskinen