Powering AI with the World's Largest Computer Chip with Joel Hestness - #684

Powering AI with the World's Largest Computer Chip with Joel Hestness - #684

Today we're joined by Joel Hestness, principal research scientist and lead of the core machine learning team at Cerebras. We discuss Cerebras’ custom silicon for machine learning, Wafer Scale Engine 3, and how the latest version of the company’s single-chip platform for ML has evolved to support large language models. Joel shares how WSE3 differs from other AI hardware solutions, such as GPUs, TPUs, and AWS’ Inferentia, and talks through the homogenous design of the WSE chip and its memory architecture. We discuss software support for the platform, including support by open source ML frameworks like Pytorch, and support for different types of transformer-based models. Finally, Joel shares some of the research his team is pursuing to take advantage of the hardware's unique characteristics, including weight-sparse training, optimizers that leverage higher-order statistics, and more. The complete show notes for this episode can be found at twimlai.com/go/684.

Avsnitt(779)

Scaling Machine Learning on Graphs at LinkedIn with Hema Raghavan and Scott Meyer - TWiML Talk #236

Scaling Machine Learning on Graphs at LinkedIn with Hema Raghavan and Scott Meyer - TWiML Talk #236

Today we’re joined by Hema Raghavan and Scott Meyer of LinkedIn to discuss the graph database and machine learning systems that power LinkedIn features such as “People You May Know” and second-degree ...

4 Mars 201946min

Safer Exploration in Deep Reinforcement Learning using Action Priors with Sicelukwanda Zwane - TWiML Talk #235

Safer Exploration in Deep Reinforcement Learning using Action Priors with Sicelukwanda Zwane - TWiML Talk #235

Today we conclude our Black in AI series with Sicelukwanda Zwane, a masters student at the University of Witwatersrand and graduate research assistant at the CSIR, who presented on “Safer Exploration ...

1 Mars 201953min

Dissecting the Controversy around OpenAI's New Language Model - TWiML Talk #234

Dissecting the Controversy around OpenAI's New Language Model - TWiML Talk #234

In the inaugural TWiML Live, Sam Charrington is joined by Amanda Askell (OpenAI), Anima Anandkumar (NVIDIA/CalTech), Miles Brundage (OpenAI), Robert Munro (Lilt), and Stephen Merity to discuss the con...

25 Feb 20191h 5min

Human-Centered Design with Mira Lane - TWiML Talk #233

Human-Centered Design with Mira Lane - TWiML Talk #233

Today we present the final episode in our AI for the Benefit of Society series, in which we’re joined by Mira Lane, Partner Director for Ethics and Society at Microsoft. Mira and I focus our conversa...

22 Feb 201946min

Fairness in Machine Learning with Hanna Wallach - TWiML Talk #232

Fairness in Machine Learning with Hanna Wallach - TWiML Talk #232

Today we’re joined by Hanna Wallach, a Principal Researcher at Microsoft Research. Hanna and I really dig into how bias and a lack of interpretability and transparency show up across ML. We discuss t...

18 Feb 201948min

AI for Healthcare with Peter Lee - TWiML Talk #231

AI for Healthcare with Peter Lee - TWiML Talk #231

In this episode, we’re joined by Peter Lee, Corporate Vice President at Microsoft Research responsible for the company’s healthcare initiatives. Peter and I met back at Microsoft Ignite, where he gave...

18 Feb 201956min

An Optimized Recurrent Unit for Ultra-Low Power Acoustic Event Detection with Justice Amoh Jr. - TWiML Talk #230

An Optimized Recurrent Unit for Ultra-Low Power Acoustic Event Detection with Justice Amoh Jr. - TWiML Talk #230

Today, we're joined by Justice Amoh Jr., a Ph.D. student at Dartmouth’s Thayer School of Engineering. Justice presented his work on “An Optimized Recurrent Unit for Ultra-Low Power Acoustic Event Det...

11 Feb 201945min

Pathologies of Neural Models and Interpretability with Alvin Grissom II - TWiML Talk #229

Pathologies of Neural Models and Interpretability with Alvin Grissom II - TWiML Talk #229

Today, we continue our Black in AI series with Alvin Grissom II, Assistant Professor of Computer Science at Ursinus College. In our conversation, we dive into the paper he presented at the workshop, “...

11 Feb 201932min

Populärt inom Politik & nyheter

motiv
p3-krim
spar
flashback-forever
svenska-fall
rss-krimstad
rss-viva-fotboll
aftonbladet-daily
aftonbladet-krim
rss-sanning-konsekvens
rss-vad-fan-hande
olyckan-inifran
fordomspodden
dagens-eko
rss-frandfors-horna
svd-ledarredaktionen
rss-krimreportrarna
rss-aftonbladet-krim
blenda-2
politiken