Jerome Pesenti — Large Language Models, PyTorch, and Meta

Jerome Pesenti — Large Language Models, PyTorch, and Meta

Jerome Pesenti is the former VP of AI at Meta, a tech conglomerate that includes Facebook, WhatsApp, and Instagram, and one of the most exciting places where AI research is happening today.

Jerome shares his thoughts on Transformers-based large language models, and why he's excited by the progress but skeptical of the term "AGI". Then, he discusses some of the practical applications of ML at Meta (recommender systems and moderation!) and dives into the story behind Meta's development of PyTorch. Jerome and Lukas also chat about Jerome's time at IBM Watson and in drug discovery.

Show notes (transcript and links): http://wandb.me/gd-jerome-pesenti

---

⏳ Timestamps:

0:00 Intro

0:28 Jerome's thought on large language models

12:53 AI applications and challenges at Meta

18:41 The story behind developing PyTorch

26:40 Jerome's experience at IBM Watson

28:53 Drug discovery, AI, and changing the game

36:10 The potential of education and AI

40:10 Meta and AR/VR interfaces

43:43 Why NVIDIA is such a powerhouse

47:08 Jerome's advice to people starting their careers

48:50 Going back to coding, the challenges of scaling

52:11 Outro

---

Connect with Jerome:

📍 Jerome on Twitter: https://twitter.com/an_open_mind

📍 Jerome on LinkedIn: https://www.linkedin.com/in/jpesenti/

---

💬 Host: Lukas Biewald

📹 Producers: Riley Fields, Angelica Pan, Lavanya Shukla

---

Subscribe and listen to our podcast today!

👉 Apple Podcasts: http://wandb.me/apple-podcasts​​

👉 Google Podcasts: http://wandb.me/google-podcasts​

👉 Spotify: http://wandb.me/spotify​

Jaksot(136)

Shaping the World of Robotics with Chelsea Finn

Shaping the World of Robotics with Chelsea Finn

In the newest episode of Gradient Dissent, Chelsea Finn, Assistant Professor at Stanford's Computer Science Department, discusses the forefront of robotics and machine learning.Discover her groundbrea...

15 Helmi 202453min

The Power of AI in Search with You.com's Richard Socher

The Power of AI in Search with You.com's Richard Socher

In the latest episode of Gradient Dissent, Richard Socher, CEO of You.com, shares his insights on the power of AI in search. The episode focuses on how advanced language models like GPT-4 are transfor...

1 Helmi 20241h 8min

AI’s Future: Investment & Impact with Sarah Guo and Elad Gil

AI’s Future: Investment & Impact with Sarah Guo and Elad Gil

Explore the Future of Investment & Impact in AI with Host Lukas Biewald and Guests Elad Gill and Sarah Guo of the No Priors podcast.Sarah is the founder of Conviction VC, an AI-centric $100 million ve...

18 Tammi 20241h 4min

Revolutionizing AI Data Management with Jerry Liu, CEO of LlamaIndex

Revolutionizing AI Data Management with Jerry Liu, CEO of LlamaIndex

In the latest episode of Gradient Dissent, we explore the innovative features and impact of LlamaIndex in AI data management with Jerry Liu, CEO of LlamaIndex. Jerry shares insights on how LlamaIndex ...

4 Tammi 202457min

Bridging AI and Science: The Impact of Machine Learning on Material Innovation with Joe Spisak of Meta

Bridging AI and Science: The Impact of Machine Learning on Material Innovation with Joe Spisak of Meta

In the latest episode of Gradient Dissent, we hear from Joseph Spisak, Product Director, Generative AI @Meta, to explore the boundless impacts of AI and its expansive role in reshaping various sectors...

7 Joulu 20231h 14min

Unlocking the Power of Language Models in Enterprise: A Deep Dive with Chris Van Pelt

Unlocking the Power of Language Models in Enterprise: A Deep Dive with Chris Van Pelt

In the premiere episode of Gradient Dissent Business, we're joined by Weights & Biases co-founder Chris Van Pelt for a deep dive into the world of large language models like GPT-3.5 and GPT-4. Chris b...

16 Marras 202352min

Providing Greater Access to LLMs with Brandon Duderstadt, Co-Founder and CEO of Nomic AI

Providing Greater Access to LLMs with Brandon Duderstadt, Co-Founder and CEO of Nomic AI

On this episode, we’re joined by Brandon Duderstadt, Co-Founder and CEO of Nomic AI. Both of Nomic AI’s products, Atlas and GPT4All, aim to improve the explainability and accessibility of AI.We discus...

27 Heinä 20231h 1min

Exploring PyTorch and Open-Source Communities with Soumith Chintala, VP/Fellow of Meta, Co-Creator of PyTorch

Exploring PyTorch and Open-Source Communities with Soumith Chintala, VP/Fellow of Meta, Co-Creator of PyTorch

On this episode, we’re joined by Soumith Chintala, VP/Fellow of Meta and Co-Creator of PyTorch. Soumith and his colleagues’ open-source framework impacted both the development process and the end-user...

13 Heinä 20231h 8min

Suosittua kategoriassa Liike-elämä ja talous

sijotuskasti
mimmit-sijoittaa
psykopodiaa-podcast
rss-rahapodi
herrasmieshakkerit
ostan-asuntoja-podcast
rss-rahamania
rss-lahtijat
rahapuhetta
rss-sami-miettinen-neuvottelija
rss-doulapodi
rss-paasipodi
yrittaja
hyva-paha-johtaminen
juristipodi
rss-sisalto-kuntoon
rss-seuraava-potilas
pomojen-suusta
seminuoret-sijoittajat
rss-porssipuhetta