Powering AI with the World's Largest Computer Chip with Joel Hestness - #684

Powering AI with the World's Largest Computer Chip with Joel Hestness - #684

Today we're joined by Joel Hestness, principal research scientist and lead of the core machine learning team at Cerebras. We discuss Cerebras’ custom silicon for machine learning, Wafer Scale Engine 3, and how the latest version of the company’s single-chip platform for ML has evolved to support large language models. Joel shares how WSE3 differs from other AI hardware solutions, such as GPUs, TPUs, and AWS’ Inferentia, and talks through the homogenous design of the WSE chip and its memory architecture. We discuss software support for the platform, including support by open source ML frameworks like Pytorch, and support for different types of transformer-based models. Finally, Joel shares some of the research his team is pursuing to take advantage of the hardware's unique characteristics, including weight-sparse training, optimizers that leverage higher-order statistics, and more. The complete show notes for this episode can be found at twimlai.com/go/684.

Avsnitt(779)

Data Science on AWS with Chris Fregly and Antje Barth - #490

Data Science on AWS with Chris Fregly and Antje Barth - #490

Today we continue our coverage of the AWS ML Summit joined by Chris Fregly, a principal developer advocate at AWS, and Antje Barth, a senior developer advocate at AWS.  In our conversation with Chris ...

7 Juni 202140min

Accelerating Distributed AI Applications at Qualcomm with Ziad Asghar - #489

Accelerating Distributed AI Applications at Qualcomm with Ziad Asghar - #489

Today we’re joined by Ziad Asghar, vice president of product management for snapdragon technologies & roadmap at Qualcomm Technologies.  We begin our conversation with Ziad exploring the symbiosis bet...

3 Juni 202139min

Buy AND Build for Production Machine Learning with Nir Bar-Lev - #488

Buy AND Build for Production Machine Learning with Nir Bar-Lev - #488

Today we’re joined by Nir Bar-Lev, co-founder and CEO of ClearML. In our conversation with Nir, we explore how his view of the wide vs deep machine learning platforms paradox has changed and evolved ...

31 Maj 202143min

Applied AI Research at AWS with Alex Smola - #487

Applied AI Research at AWS with Alex Smola - #487

Today we’re joined by Alex Smola, Vice President and Distinguished Scientist at AWS AI. We had the pleasure to catch up with Alex prior to the upcoming AWS Machine Learning Summit, and we covered a TO...

27 Maj 202155min

Causal Models in Practice at Lyft with Sean Taylor - #486

Causal Models in Practice at Lyft with Sean Taylor - #486

Today we’re joined by Sean Taylor, Staff Data Scientist at Lyft Rideshare Labs. We cover a lot of ground with Sean, starting with his recent decision to step away from his previous role as the lab dir...

24 Maj 202140min

Using AI to Map the Human Immune System w/ Jabran Zahid - #485

Using AI to Map the Human Immune System w/ Jabran Zahid - #485

Today we’re joined by Jabran Zahid, a Senior Researcher at Microsoft Research. In our conversation with Jabran, we explore their recent endeavor into the complete mapping of which T-cells bind to whic...

20 Maj 202141min

Learning Long-Time Dependencies with RNNs w/ Konstantin Rusch - #484

Learning Long-Time Dependencies with RNNs w/ Konstantin Rusch - #484

Today we conclude our 2021 ICLR coverage joined by Konstantin Rusch, a PhD Student at ETH Zurich. In our conversation with Konstantin, we explore his recent papers, titled coRNN and uniCORNN respectiv...

17 Maj 202137min

What the Human Brain Can Tell Us About NLP Models with Allyson Ettinger - #483

What the Human Brain Can Tell Us About NLP Models with Allyson Ettinger - #483

Today we continue our ICLR ‘21 series joined by Allyson Ettinger, an Assistant Professor at the University of Chicago.  One of our favorite recurring conversations on the podcast is the two-way street...

13 Maj 202138min

Populärt inom Politik & nyheter

motiv
p3-krim
spar
flashback-forever
rss-viva-fotboll
svenska-fall
rss-krimstad
aftonbladet-daily
rss-sanning-konsekvens
aftonbladet-krim
rss-vad-fan-hande
olyckan-inifran
dagens-eko
fordomspodden
rss-aftonbladet-krim
svd-ledarredaktionen
rss-frandfors-horna
rss-klubbland-en-podd-mest-om-frolunda
spotlight
blenda-2