Episode 18 - Why AI needs a new kind of supercomputer network

Episode 18 - Why AI needs a new kind of supercomputer network

Training frontier models isn’t as simple as adding more GPUs—one small problem and the whole coordinated dance falls apart. OpenAI’s Mark Handley and Greg Steinbrecher discuss how a new supercomputer network design, used to train some of the company’s latest models, keeps the whole system moving in lockstep, even with record numbers of GPUs. They break down Multipath Reliable Connection, a new protocol OpenAI developed with AMD, Broadcom, Intel, Microsoft, and Nvidia, and why they’re making it available for the whole industry to use.


Chapters

00:00 Intro

00:39 Greg and Mark's paths to OpenAI

04:34 Why training AI stresses networks differently

10:05 Bottlenecks, failures, and the cost of waiting

15:19 How Multipath Reliable Connection works

18:59 A protocol to route around failures

25:05 Why OpenAI is making MRC an open standard

35:09 Could AI compute move to space?



Hosted on Acast. See acast.com/privacy for more information.

Denne episoden er hentet fra en åpen RSS-feed og er ikke publisert av Podme. Den kan derfor inneholde annonser.

Episoder(20)

Episode 19 - Inside image generation’s Renaissance moment

Episode 19 - Inside image generation’s Renaissance moment

People are generating over 1.5 billion images a week in ChatGPT. In this episode, Product lead Adele Li and researcher Kenji Hata share some of the new use cases and trends since the launch of Images ...

14 Mai 29min

Episode 17 - What happens now that AI is good at math?

Episode 17 - What happens now that AI is good at math?

Math is one of the clearest ways to see how far AI has come in a short span. OpenAI researchers Sébastien Bubeck and Ernest Ryu join host Andrew Mayne to explain what changed and what it could mean fo...

28 Apr 43min

Episode 16 - Building AI for Life Sciences

Episode 16 - Building AI for Life Sciences

What does it take to build AI systems that can actually help scientists? Research lead Joy Jiao and product lead Yunyun Wang discuss how OpenAI is developing models for life sciences and what responsi...

16 Apr 44min

Episode 15 - Inside the Model Spec

Episode 15 - Inside the Model Spec

The more AI can do, the more we need to ask what it should and shouldn’t do. In this episode, OpenAI researcher Jason Wolfe joins host Andrew Mayne to talk about the Model Spec, the public framework t...

25 Mar 37min

Episode 14 - Building AI for better healthcare

Episode 14 - Building AI for better healthcare

Healthcare systems around the world are under strain, and both patients and clinicians are feeling the impact. OpenAI's Head of Health Dr. Nate Gross and Karan Singhal, who leads Health AI Research, d...

16 Mar 30min

Episode 13 - The Thinking Behind Ads in ChatGPT

Episode 13 - The Thinking Behind Ads in ChatGPT

How should advertising work in an AI product? Asad Awan, one of the ad leads at OpenAI, walks through how the company is approaching this decision and why it’s testing ads in ChatGPT at all. He explai...

9 Feb 25min

Episode 12 - State of the AI Industry

Episode 12 - State of the AI Industry

OpenAI CFO Sarah Friar and Khosla Ventures founder Vinod Khosla argue the greatest challenges in AI right now are keeping up with demand and making sure more people get the benefit. They unpack what's...

19 Jan 49min

Populært innen Vitenskap

fastlegen
tingenes-tilstand
jss
liberal-halvtime
rekommandert
sinnsyn
forskningno
dekodet-2
villmarksliv
rss-paradigmepodden
rss-nysgjerrige-norge
rss-zahid-ali-hjelper-deg
tomprat-med-gunnar-tjomlid
nevropodden
fjellsportpodden
grunnstoffene
rss-inn-til-kjernen-med-sunniva-rose
diagnose
tidlose-historier
rss-rekommandert