Ronen Dar on GPU Orchestration for Building ML Models
Data Driven5 Feb 2024

Ronen Dar on GPU Orchestration for Building ML Models

In this episode, our Andy Leonard and Frank La Vigne sit down with Ronen Dar, the co-founder and CTO of Run AI, to explore the world of artificial intelligence and GPU orchestration for machine learning models.

Ronen shares insights into the challenges of utilizing GPUs in AI research and how Run AI's platform addresses these issues by optimizing GPU usage and providing tools for easier and faster model training and deployment. The conversation delves into the concept of fractional GPU usage, allowing multiple workloads to run on a single GPU, making expensive GPUs more accessible and cost-effective for organizations.

Links
Show Notes

04:40 GPU technology enabled for cloud AI workloads.

07:00 RunAI enables sharing expensive GPU resources for all.

11:59 As enterprise AI matures, organizations become more savvy.

15:35 Deep learning, GPUs for speed, CPUs backup.

16:54 LLMs running on GPU's, exploding in market.

23:29 NVIDIA created CUDA to simplify GPU use.

26:21 NVIDIA's success lies in accessible technology.

28:25 Solve GPU hugging with quotas and sharing.

31:15 Team lead manages GPU quotas for researchers.

35:51 Rapid changes in business and innovation.

40:34 Passionate problem-solver with diverse tech background.

43:38 Thanks for tuning in, subscribe and review.

Episoder(300)

Synthetic Populations and the Future of Decision Intelligence

Synthetic Populations and the Future of Decision Intelligence

In this episode of Data Driven, Frank and Andy dive into the future of market intelligence with Dr. Jill Axline, co-founder and CEO of Mavera—a company building synthetic populations that simulate rea...

29 Jan 50min

Microsoft Fabric Unpacked: AI, Data Sovereignty, and a Bit of Clippy Nostalgia

Microsoft Fabric Unpacked: AI, Data Sovereignty, and a Bit of Clippy Nostalgia

In today’s show, BAILeY, your semi-sentient hostess with the mostest metadata, teams up with Frank La Vigne to welcome the ever-insightful Andrew Brust for a deep dive into the evolving Microsoft data...

12 Jan 54min

Celebrating 400 Episodes – How AI Turbocharges Coding, Podcasting, and Creativity

Celebrating 400 Episodes – How AI Turbocharges Coding, Podcasting, and Creativity

Welcome to a milestone episode of Data Driven! In episode 400, hosts BAILeY, Frank La Vigne, and Andy Leonard gather to reflect on nearly a decade at the forefront of podcasting about data, AI, and th...

8 Jan 1h

The Real Risks of LLMs - Guardrails, Judgment, and the Human Element in Cybersecurity

The Real Risks of LLMs - Guardrails, Judgment, and the Human Element in Cybersecurity

In this episode of Data Driven, hosts Frank La Vigne, Candace Gillhoolley, and BAILeY sit down with Mike Armistead, CEO of Pulse Security AI—a cybersecurity veteran who's been fortifying digital defen...

26 Nov 202558min

Going From Spreadsheets to Smart Agents - Modernizing Supply Chain Intelligence

Going From Spreadsheets to Smart Agents - Modernizing Supply Chain Intelligence

In this episode, Frank La Vigne sits down with Itay Haber, CEO of Data Noetic, to unpack how AI is revolutionizing supply chain management. Forget spreadsheets and dashboards—Data Noetic is building a...

19 Nov 202558min

Inside Nvidia GTC DC: AI, Quantum Computing, Robotics, and the Future of Supercomputers

Inside Nvidia GTC DC: AI, Quantum Computing, Robotics, and the Future of Supercomputers

Welcome to another exciting episode of Data Driven! On this week’s show, hosts Frank La Vigne and Candace Gillhoolley take you inside the NVIDIA GTC conference in Washington, DC—an event that’s rapidl...

30 Okt 202554min

The Fast-Moving Train of AI - Sovereignty, Acceleration, & Lessons from History

The Fast-Moving Train of AI - Sovereignty, Acceleration, & Lessons from History

On this episode of Data Driven, hosts Frank La Vigne and Leonard celebrate a major milestone: the 30th anniversary of Franksworld.com, one of the OGs of tech blogging that’s survived multiple browser ...

13 Okt 20251h 15min

Compute, Carbon, and Cashflow Silicon Data’s Big Bet on GPU Markets

Compute, Carbon, and Cashflow Silicon Data’s Big Bet on GPU Markets

Welcome to another episode of Data Driven, where we dive deep into how data and AI are shaping—sometimes shaking—the modern world. In this episode, hosts Frank La Vigne, Andy Leonard, and Carmen Li si...

1 Okt 202550min

Populært innen Vitenskap

fastlegen
tingenes-tilstand
rekommandert
jss
rss-rekommandert
sinnsyn
forskningno
tomprat-med-gunnar-tjomlid
villmarksliv
fjellsportpodden
rss-overskuddsliv
rss-paradigmepodden
tidlose-historier
rss-skogkurs-podden
grunnstoffene
vett-og-vitenskap-med-gaute-einevoll
dekodet-2
rss-nysgjerrige-norge
diagnose
kvinnehelsepodden