Ronen Dar on GPU Orchestration for Building ML Models
Data Driven5 Feb 2024

Ronen Dar on GPU Orchestration for Building ML Models

In this episode, our Andy Leonard and Frank La Vigne sit down with Ronen Dar, the co-founder and CTO of Run AI, to explore the world of artificial intelligence and GPU orchestration for machine learning models.

Ronen shares insights into the challenges of utilizing GPUs in AI research and how Run AI's platform addresses these issues by optimizing GPU usage and providing tools for easier and faster model training and deployment. The conversation delves into the concept of fractional GPU usage, allowing multiple workloads to run on a single GPU, making expensive GPUs more accessible and cost-effective for organizations.

Links
Show Notes

04:40 GPU technology enabled for cloud AI workloads.

07:00 RunAI enables sharing expensive GPU resources for all.

11:59 As enterprise AI matures, organizations become more savvy.

15:35 Deep learning, GPUs for speed, CPUs backup.

16:54 LLMs running on GPU's, exploding in market.

23:29 NVIDIA created CUDA to simplify GPU use.

26:21 NVIDIA's success lies in accessible technology.

28:25 Solve GPU hugging with quotas and sharing.

31:15 Team lead manages GPU quotas for researchers.

35:51 Rapid changes in business and innovation.

40:34 Passionate problem-solver with diverse tech background.

43:38 Thanks for tuning in, subscribe and review.

Episoder(300)

Why Simulating Reality Is the Key to Advancing Artificial Intelligence

Why Simulating Reality Is the Key to Advancing Artificial Intelligence

In this episode, we're joined once again by Christopher Nuland, technical marketing manager at Red Hat, whose globe-trotting schedule rivals the complexity of a Kubernetes deployment. Christopher sits...

25 Sep 202553min

Dr Ido Zamberg on The Role of AI in Modern Healthcare Delivery From Databases to Defibrillators

Dr Ido Zamberg on The Role of AI in Modern Healthcare Delivery From Databases to Defibrillators

Welcome to another episode of Data Driven! Today, hosts Frank La Vigne and Andy Leonard, are joined by Dr. Ido Zamberg—a rare breed who’s equally comfortable rebooting servers and saving lives. Dr. Za...

25 Aug 202552min

Thanos Diakakis on Surviving the Software Apocalypse – AI, Agile, and Good Engineering

Thanos Diakakis on Surviving the Software Apocalypse – AI, Agile, and Good Engineering

On this episode of Data Driven, we venture into the ever-shifting landscape of software engineering, AI-assisted coding, and the sometimes chaotic future of development teams with special guest Thanos...

20 Aug 202558min

Dr Mike Orkin on Blackjack, Lightning, and Apophenia: The Surprising Psychology of Probability

Dr Mike Orkin on Blackjack, Lightning, and Apophenia: The Surprising Psychology of Probability

On this episode of Data Driven, we’re shuffling up some probability, statistics, and a bit of Las Vegas magic with Dr. Michael Orkin—a renowned statistician, data scientist, and former advisor to casi...

12 Aug 20251h 8min

From Cold War to Code Wars: Unpacking America’s Bold AI Strategy

From Cold War to Code Wars: Unpacking America’s Bold AI Strategy

Welcome to another episode of Data Driven, where we delve deep into the crossroads of data, technology, and the ever-shifting world of geopolitics. In this packed episode, hosts Frank La Vigne and Bai...

30 Jul 20251h 5min

Dr Alan Bekker on Multimodal Avatars, Education, and Authentic Digital Connections

Dr Alan Bekker on Multimodal Avatars, Education, and Authentic Digital Connections

In today’s conversation, hosts BAILeY and Frank La Vigne sit down with Dr. Alan Becker, co-founder and CEO of E Self AI and former co-founder of Voca AI, which was acquired by Snap in 2020. Dr. Becker...

23 Jul 202557min

Christopher Nuland on Stacking Servers & Superintelligence: Hype and Reality Behind AI 2027

Christopher Nuland on Stacking Servers & Superintelligence: Hype and Reality Behind AI 2027

Welcome to another episode of Data Driven—the podcast where we explore the future of technology, one neural network at a time. In this episode, your hosts Frank La Vigne and Bailey are joined by Chris...

15 Jul 202543min

Amir Berman on Making Construction Smarter with AI and Analytics

Amir Berman on Making Construction Smarter with AI and Analytics

In this episode, host Frank La Vigne is joined by Amir Berman, VP of Industry Transformation at Buildots, to explore how AI, computer vision, and cutting-edge analytics are revolutionizing the constru...

13 Jun 20251h 1min

Populært innen Vitenskap

fastlegen
tingenes-tilstand
rekommandert
jss
vett-og-vitenskap-med-gaute-einevoll
smart-forklart
rss-nysgjerrige-norge
rss-rekommandert
forskningno
sinnsyn
fjellsportpodden
rss-paradigmepodden
villmarksliv
pod-britannia
nordnorsk-historie
aldring-og-helse-podden
diagnose
tidlose-historier
rss-overskuddsliv
tomprat-med-gunnar-tjomlid