Powering AI with the World's Largest Computer Chip with Joel Hestness - #684

Powering AI with the World's Largest Computer Chip with Joel Hestness - #684

Today we're joined by Joel Hestness, principal research scientist and lead of the core machine learning team at Cerebras. We discuss Cerebras’ custom silicon for machine learning, Wafer Scale Engine 3, and how the latest version of the company’s single-chip platform for ML has evolved to support large language models. Joel shares how WSE3 differs from other AI hardware solutions, such as GPUs, TPUs, and AWS’ Inferentia, and talks through the homogenous design of the WSE chip and its memory architecture. We discuss software support for the platform, including support by open source ML frameworks like Pytorch, and support for different types of transformer-based models. Finally, Joel shares some of the research his team is pursuing to take advantage of the hardware's unique characteristics, including weight-sparse training, optimizers that leverage higher-order statistics, and more. The complete show notes for this episode can be found at twimlai.com/go/684.

Episoder(779)

Algorithmic Injustices and Relational Ethics with Abeba Birhane - #348

Algorithmic Injustices and Relational Ethics with Abeba Birhane - #348

Today we’re joined by Abeba Birhane, PhD Student at University College Dublin and author of the recent paper Algorithmic Injustices: Towards a Relational Ethics, which was the recipient of the Best Pa...

13 Feb 202041min

AI for Agriculture and Global Food Security with Nemo Semret - #347

AI for Agriculture and Global Food Security with Nemo Semret - #347

Today we’re excited to kick off our annual Black in AI Series joined by Nemo Semret, CTO of Gro Intelligence. Gro provides an agricultural data platform dedicated to improving global food security, fo...

10 Feb 20201h 4min

Practical Differential Privacy at LinkedIn with Ryan Rogers - #346

Practical Differential Privacy at LinkedIn with Ryan Rogers - #346

Today we’re joined by Ryan Rogers, Senior Software Engineer at LinkedIn, to discuss his paper “Practical Differentially Private Top-k Selection with Pay-what-you-get Composition.” In our conversation,...

7 Feb 202033min

Networking Optimizations for Multi-Node Deep Learning on Kubernetes with Erez Cohen - #345

Networking Optimizations for Multi-Node Deep Learning on Kubernetes with Erez Cohen - #345

Today we conclude the KubeCon ‘19 series joined by Erez Cohen, VP of CloudX & AI at Mellanox, who we caught up with before his talk “Networking Optimizations for Multi-Node Deep Learning on Kubernetes...

5 Feb 202031min

Managing Research Needs at the University of Michigan using Kubernetes w/ Bob Killen - #344

Managing Research Needs at the University of Michigan using Kubernetes w/ Bob Killen - #344

Today we’re joined by Bob Killen, Research Cloud Administrator at the University of Michigan. In our conversation, we explore how Bob and his group at UM are deploying Kubernetes, the user experience,...

3 Feb 202025min

Scalable and Maintainable Workflows at Lyft with Flyte w/ Haytham AbuelFutuh and Ketan Umare - #343

Scalable and Maintainable Workflows at Lyft with Flyte w/ Haytham AbuelFutuh and Ketan Umare - #343

Today we kick off our KubeCon ‘19 series joined by Haytham AbuelFutuh and Ketan Umare, a pair of software engineers at Lyft. We caught up with Haytham and Ketan at KubeCo, where they were presenting t...

30 Jan 202045min

Causality 101 with Robert Osazuwa Ness - #342

Causality 101 with Robert Osazuwa Ness - #342

Today Robert Osazuwa Ness, ML Research Engineer at Gamalon and Instructor at Northeastern University joins us to discuss Causality, what it means, and how that meaning changes across domains and users...

27 Jan 202039min

PaccMann^RL: Designing Anticancer Drugs with Reinforcement Learning w/ Jannis Born - #341

PaccMann^RL: Designing Anticancer Drugs with Reinforcement Learning w/ Jannis Born - #341

Today we’re joined by Jannis Born, Ph.D. student at ETH & IBM Research Zurich, to discuss his “PaccMann^RL” research. Jannis details how his background in computational neuroscience applies to this re...

23 Jan 202042min

Populært innen Politikk og nyheter

giver-og-gjengen-vg
aftenpodden
aftenpodden-usa
i-retten
forklart
popradet
stopp-verden
det-store-bildet
dine-penger-pengeradet
rss-gukild-johaug
fotballpodden-2
nokon-ma-ga
bt-dokumentar-2
hanna-de-heldige
aftenbla-bla
chit-chat-med-helle
frokostshowet-pa-p5
rss-dannet-uten-piano
rss-ness
e24-podden