Powering AI with the World's Largest Computer Chip with Joel Hestness - #684

Powering AI with the World's Largest Computer Chip with Joel Hestness - #684

Today we're joined by Joel Hestness, principal research scientist and lead of the core machine learning team at Cerebras. We discuss Cerebras’ custom silicon for machine learning, Wafer Scale Engine 3, and how the latest version of the company’s single-chip platform for ML has evolved to support large language models. Joel shares how WSE3 differs from other AI hardware solutions, such as GPUs, TPUs, and AWS’ Inferentia, and talks through the homogenous design of the WSE chip and its memory architecture. We discuss software support for the platform, including support by open source ML frameworks like Pytorch, and support for different types of transformer-based models. Finally, Joel shares some of the research his team is pursuing to take advantage of the hardware's unique characteristics, including weight-sparse training, optimizers that leverage higher-order statistics, and more. The complete show notes for this episode can be found at twimlai.com/go/684.

Avsnitt(779)

Language Modeling and Protein Generation at Salesforce with Richard Socher - #372

Language Modeling and Protein Generation at Salesforce with Richard Socher - #372

Today we’re joined Richard Socher, Chief Scientist and Executive VP at Salesforce. Richard and his team have published quite a few great projects lately, including CTRL: A Conditional Transformer Lang...

4 Maj 202042min

AI Research at JPMorgan Chase with Manuela Veloso - #371

AI Research at JPMorgan Chase with Manuela Veloso - #371

Today we’re joined by Manuela Veloso, Head of AI Research at J.P. Morgan Chase. Since moving from CMU to JP Morgan Chase, Manuela and her team established a set of seven lofty research goals. In this ...

30 Apr 202046min

Panel: Responsible Data Science in the Fight  Against COVID-19 - #370

Panel: Responsible Data Science in the Fight Against COVID-19 - #370

In this discussion, we explore how data scientists and ML/AI practitioners can responsibly contribute to the fight against coronavirus and COVID-19. Four experts: Rex Douglass, Rob Munro, Lea Shanley,...

29 Apr 202058min

Adversarial Examples Are Not Bugs, They Are Features with Aleksander Madry - #369

Adversarial Examples Are Not Bugs, They Are Features with Aleksander Madry - #369

Today we’re joined by Aleksander Madry, Faculty in the MIT EECS Department, to discuss his paper “Adversarial Examples Are Not Bugs, They Are Features.” In our conversation, we talk through what we ex...

27 Apr 202041min

AI for Social Good: Why "Good" isn't Enough with Ben Green - #368

AI for Social Good: Why "Good" isn't Enough with Ben Green - #368

Today we’re joined by Ben Green, PhD Candidate at Harvard and Research Fellow at the AI Now Institute at NYU. Ben’s research is focused on the social and policy impacts of data science, with a focus...

23 Apr 202041min

The Evolution of Evolutionary AI with Risto Miikkulainen - #367

The Evolution of Evolutionary AI with Risto Miikkulainen - #367

Today we’re joined by Risto Miikkulainen, Associate VP of Evolutionary AI at Cognizant AI. Risto joined us back on episode #47 to discuss evolutionary algorithms, and today we get an update on the lat...

20 Apr 202037min

Neural Architecture Search and Google’s New AutoML Zero with Quoc Le - #366

Neural Architecture Search and Google’s New AutoML Zero with Quoc Le - #366

Today we’re super excited to share our recent conversation with Quoc Le, a research scientist at Google. Quoc joins us to discuss his work on Google’s AutoML Zero, semi-supervised learning, and the de...

16 Apr 202054min

Automating Electronic Circuit Design with Deep RL w/ Karim Beguir - #365

Automating Electronic Circuit Design with Deep RL w/ Karim Beguir - #365

Today we’re joined by return guest Karim Beguir, Co-Founder and CEO of InstaDeep. In our conversation, we chat with Karim about InstaDeep’s new offering, DeepPCB, an end-to-end platform for automated ...

13 Apr 202035min

Populärt inom Politik & nyheter

motiv
aftonbladet-krim
p3-krim
spar
flashback-forever
rss-viva-fotboll
svenska-fall
rss-sanning-konsekvens
rss-krimstad
aftonbladet-daily
svd-dokumentara-berattelser-2
rss-vad-fan-hande
rss-krimreportrarna
rss-frandfors-horna
krimmagasinet
rss-aftonbladet-krim
olyckan-inifran
dagens-eko
fordomspodden
svd-ledarredaktionen