Jerome Pesenti — Large Language Models, PyTorch, and Meta

Jerome Pesenti — Large Language Models, PyTorch, and Meta

Jerome Pesenti is the former VP of AI at Meta, a tech conglomerate that includes Facebook, WhatsApp, and Instagram, and one of the most exciting places where AI research is happening today.

Jerome shares his thoughts on Transformers-based large language models, and why he's excited by the progress but skeptical of the term "AGI". Then, he discusses some of the practical applications of ML at Meta (recommender systems and moderation!) and dives into the story behind Meta's development of PyTorch. Jerome and Lukas also chat about Jerome's time at IBM Watson and in drug discovery.

Show notes (transcript and links): http://wandb.me/gd-jerome-pesenti

---

⏳ Timestamps:

0:00 Intro

0:28 Jerome's thought on large language models

12:53 AI applications and challenges at Meta

18:41 The story behind developing PyTorch

26:40 Jerome's experience at IBM Watson

28:53 Drug discovery, AI, and changing the game

36:10 The potential of education and AI

40:10 Meta and AR/VR interfaces

43:43 Why NVIDIA is such a powerhouse

47:08 Jerome's advice to people starting their careers

48:50 Going back to coding, the challenges of scaling

52:11 Outro

---

Connect with Jerome:

📍 Jerome on Twitter: https://twitter.com/an_open_mind

📍 Jerome on LinkedIn: https://www.linkedin.com/in/jpesenti/

---

💬 Host: Lukas Biewald

📹 Producers: Riley Fields, Angelica Pan, Lavanya Shukla

---

Subscribe and listen to our podcast today!

👉 Apple Podcasts: http://wandb.me/apple-podcasts​​

👉 Google Podcasts: http://wandb.me/google-podcasts​

👉 Spotify: http://wandb.me/spotify​

Jaksot(134)

Shaping AI Benchmarks with Together AI Co-Founder Percy Liang

Shaping AI Benchmarks with Together AI Co-Founder Percy Liang

In this episode of Gradient Dissent, Together AI co-founder and Stanford Associate Professor Percy Liang joins host, Lukas Biewald, to discuss advancements in AI benchmarking and the pivotal role that...

9 Touko 202453min

Accelerating drug discovery with AI: Insights from Isomorphic Labs

Accelerating drug discovery with AI: Insights from Isomorphic Labs

In this episode of Gradient Dissent, Isomorphic Labs Chief AI Officer Max Jaderberg, and Chief Technology Officer Sergei Yakneen join our host Lukas Biewald to discuss the advancements in biotech and ...

25 Huhti 20241h 10min

Redefining AI Hardware for Enterprise with SambaNova’s Rodrigo Liang

Redefining AI Hardware for Enterprise with SambaNova’s Rodrigo Liang

🚀 Discover the cutting-edge AI hardware development for enterprises in this episode of Gradient Dissent, featuring Rodrigo Liang, CEO of SambaNova Systems. Rodrigo Liang’s journey from Oracle to foun...

11 Huhti 202453min

Navigating the Vector Database Landscape with Pinecone's Edo Liberty

Navigating the Vector Database Landscape with Pinecone's Edo Liberty

🚀 This episode of Gradient Dissent welcomes Edo Liberty, the mind behind Pinecone's revolutionary vector database technology.As a former leader at Amazon AI Labs and Yahoo's New York lab, Edo Liberty...

28 Maalis 20241h 6min

Transforming Data into Business Solutions with Salesforce AI CEO, Clara Shih

Transforming Data into Business Solutions with Salesforce AI CEO, Clara Shih

🚀 In this episode of Gradient Dissent, we explore the revolutionary impact of AI across industries with Clara Shih, CEO of Salesforce AI and Founder of Hearsay Systems. Dive into Salesforce AI's cutt...

14 Maalis 202458min

Upgrading Your Health: Navigating AI's Future In Healthcare with John Halamka of Mayo Clinic Platform

Upgrading Your Health: Navigating AI's Future In Healthcare with John Halamka of Mayo Clinic Platform

In the newest episode of Gradient Dissent, we explore the intersecting worlds of AI and Healthcare with John Halamka, President of the Mayo Clinic Platform.Journey with us down John Halamka's remarkab...

29 Helmi 20241h 4min

Shaping the World of Robotics with Chelsea Finn

Shaping the World of Robotics with Chelsea Finn

In the newest episode of Gradient Dissent, Chelsea Finn, Assistant Professor at Stanford's Computer Science Department, discusses the forefront of robotics and machine learning.Discover her groundbrea...

15 Helmi 202453min

The Power of AI in Search with You.com's Richard Socher

The Power of AI in Search with You.com's Richard Socher

In the latest episode of Gradient Dissent, Richard Socher, CEO of You.com, shares his insights on the power of AI in search. The episode focuses on how advanced language models like GPT-4 are transfor...

1 Helmi 20241h 8min

Suosittua kategoriassa Liike-elämä ja talous

sijotuskasti
mimmit-sijoittaa
rss-rahapodi
psykopodiaa-podcast
rss-rahamania
herrasmieshakkerit
ostan-asuntoja-podcast
rss-20-30-40-podcast
rahapuhetta
rss-seuraava-potilas
rss-inderes-femme
rss-myynnilla-on-asiaa-kert-kenner
rss-lahtijat
rss-paasipodi
rss-strategian-seurassa
rss-porssipuhetta
rss-startup-ministerio
rss-bisnesta-bebeja
rss-sisalto-kuntoon
rss-vaikuttavan-opettajan-vierella