Powering AI with the World's Largest Computer Chip with Joel Hestness - #684

Powering AI with the World's Largest Computer Chip with Joel Hestness - #684

Today we're joined by Joel Hestness, principal research scientist and lead of the core machine learning team at Cerebras. We discuss Cerebras’ custom silicon for machine learning, Wafer Scale Engine 3, and how the latest version of the company’s single-chip platform for ML has evolved to support large language models. Joel shares how WSE3 differs from other AI hardware solutions, such as GPUs, TPUs, and AWS’ Inferentia, and talks through the homogenous design of the WSE chip and its memory architecture. We discuss software support for the platform, including support by open source ML frameworks like Pytorch, and support for different types of transformer-based models. Finally, Joel shares some of the research his team is pursuing to take advantage of the hardware's unique characteristics, including weight-sparse training, optimizers that leverage higher-order statistics, and more. The complete show notes for this episode can be found at twimlai.com/go/684.

Episoder(779)

Data Governance for Data Science with Adam Wood - #578

Data Governance for Data Science with Adam Wood - #578

Today we’re joined by Adam Wood, Director of Data Governance and Data Quality at Mastercard. In our conversation with Adam, we explore the challenges that come along with data governance at a global s...

13 Jun 202239min

Feature Platforms for Data-Centric AI with Mike Del Balso - #577

Feature Platforms for Data-Centric AI with Mike Del Balso - #577

In the latest installment of our Data-Centric AI series, we’re joined by a friend of the show Mike Del Balso, Co-founder and CEO of Tecton. If you’ve heard any of our other conversations with Mike, yo...

6 Jun 202246min

The Fallacy of "Ground Truth" with Shayan Mohanty - #576

The Fallacy of "Ground Truth" with Shayan Mohanty - #576

Today we continue our Data-centric AI series joined by Shayan Mohanty, CEO at Watchful. In our conversation with Shayan, we focus on the data labeling aspect of the machine learning process, and ways ...

30 Mai 202251min

Principle-centric AI with Adrien Gaidon - #575

Principle-centric AI with Adrien Gaidon - #575

This week, we continue our conversations around the topic of Data-Centric AI joined by a friend of the show Adrien Gaidon, the head of ML research at the Toyota Research Institute (TRI). In our chat, ...

23 Mai 202247min

Data Debt in Machine Learning with D. Sculley - #574

Data Debt in Machine Learning with D. Sculley - #574

Today we kick things off with a conversation with D. Sculley, a director on the Google Brain team. Many listeners of today’s show will know D. from his work on the paper, The Hidden Technical Debt in ...

19 Mai 202236min

AI for Enterprise Decisioning at Scale with Rob Walker - #573

AI for Enterprise Decisioning at Scale with Rob Walker - #573

Today we’re joined by Rob Walker, VP of decisioning & analytics and gm of one-to-one customer engagement at Pegasystems. Rob, who you might know from his previous appearances on the podcast, joins us ...

16 Mai 202239min

Data Rights, Quantification and Governance for Ethical AI with Margaret Mitchell - #572

Data Rights, Quantification and Governance for Ethical AI with Margaret Mitchell - #572

Today we close out our coverage of the ICLR series joined by Meg Mitchell, chief ethics scientist and researcher at Hugging Face. In our conversation with Meg, we discuss her participation in the Wiki...

12 Mai 202241min

Studying Machine Intelligence with Been Kim - #571

Studying Machine Intelligence with Been Kim - #571

Today we continue our ICLR coverage joined by Been Kim, a staff research scientist at Google Brain, and an ICLR 2022 Invited Speaker. Been, whose research has historically been focused on interpretabi...

9 Mai 202252min

Populært innen Politikk og nyheter

giver-og-gjengen-vg
aftenpodden
aftenpodden-usa
forklart
popradet
stopp-verden
det-store-bildet
bt-dokumentar-2
rss-gukild-johaug
dine-penger-pengeradet
nokon-ma-ga
lydartikler-fra-aftenposten
fotballpodden-2
hanna-de-heldige
frokostshowet-pa-p5
rss-penger-polser-og-politikk
aftenbla-bla
e24-podden
rss-dannet-uten-piano
rss-ness