Ronen Dar on GPU Orchestration for Building ML Models
Data Driven5 Feb 2024

Ronen Dar on GPU Orchestration for Building ML Models

In this episode, our Andy Leonard and Frank La Vigne sit down with Ronen Dar, the co-founder and CTO of Run AI, to explore the world of artificial intelligence and GPU orchestration for machine learning models.

Ronen shares insights into the challenges of utilizing GPUs in AI research and how Run AI's platform addresses these issues by optimizing GPU usage and providing tools for easier and faster model training and deployment. The conversation delves into the concept of fractional GPU usage, allowing multiple workloads to run on a single GPU, making expensive GPUs more accessible and cost-effective for organizations.

Links
Show Notes

04:40 GPU technology enabled for cloud AI workloads.

07:00 RunAI enables sharing expensive GPU resources for all.

11:59 As enterprise AI matures, organizations become more savvy.

15:35 Deep learning, GPUs for speed, CPUs backup.

16:54 LLMs running on GPU's, exploding in market.

23:29 NVIDIA created CUDA to simplify GPU use.

26:21 NVIDIA's success lies in accessible technology.

28:25 Solve GPU hugging with quotas and sharing.

31:15 Team lead manages GPU quotas for researchers.

35:51 Rapid changes in business and innovation.

40:34 Passionate problem-solver with diverse tech background.

43:38 Thanks for tuning in, subscribe and review.

Denne episoden er hentet fra en åpen RSS-feed og er ikke publisert av Podme. Den kan derfor inneholde annonser.

Episoder(300)

Exploring the Collision of AI and DevOps Worlds at KubeCon North America Day Zero

Exploring the Collision of AI and DevOps Worlds at KubeCon North America Day Zero

Welcome to a special episode of Data Driven, coming to you from day zero of KubeCon North America 2026 in Salt Lake City. The conversation focused on the evolving intersection between data, AI, and De...

9 Nov 4min

Your SQL Is Correct. Why Is Your Report Wrong?

Your SQL Is Correct. Why Is Your Report Wrong?

Welcome to another episode of Data Driven, the podcast where the worlds of artificial intelligence, data science, and data engineering intersect. In this episode, the conversation focused on the cruci...

9 Nov 38min

Human Oversight in AI Agents – Addressing Trust, Authorization, and Enterprise Governance

Human Oversight in AI Agents – Addressing Trust, Authorization, and Enterprise Governance

The conversation focused on the complex realities of deploying AI agents in enterprise environments, moving beyond the hype to examine what these agents should be allowed to do versus what they can do...

3 Nov 44min

Your Security Model Is Stuck in the ’80s. AI Isn’t.

Your Security Model Is Stuck in the ’80s. AI Isn’t.

In this episode of Data Driven, Frank La Vigne talks with Richard Luna, CEO of Protected Harbor, about why security built around keeping attackers outside a network leaves organizations exposed once s...

5 Okt 50min

Beyond Dashboards – How Decision Intelligence Optimizes Industrial Asset Risk

Beyond Dashboards – How Decision Intelligence Optimizes Industrial Asset Risk

In this episode of Data Driven, host Frank La Vigne sits down with Andy Pruett, co-founder and CEO of Lumiscent, to explore a topic often overlooked in the industrial sector: it’s not a data problem—i...

29 Sep 50min

How Compliance Became Cool: Richa Kaul on Security, Privacy, and AI

How Compliance Became Cool: Richa Kaul on Security, Privacy, and AI

Welcome back to "Data Driven," the podcast where we explore the cutting edge of data science, AI, and the rapidly evolving world of data governance.In this episode, we sit down with Richa Kaul, founde...

21 Sep 45min

Why Business Knowledge Beats Tool Complexity in the AI Era

Why Business Knowledge Beats Tool Complexity in the AI Era

Welcome back to Data Driven, the podcast where we dive deep into the evolving worlds of data science, business intelligence, and artificial intelligence. In this episode, host Frank La Vigne sits down...

16 Sep 54min

Bridging AI and Human Intelligence – Multicolor Lasers and the Future of Photonic Computing

Bridging AI and Human Intelligence – Multicolor Lasers and the Future of Photonic Computing

Welcome to another episode of Impact Quantum, where we explore the cutting edge of quantum computing and emerging technologies reshaping our world.Today, co-hosts Frank La Vigne and Candace Gillhoolle...

15 Sep 54min

Populært innen Vitenskap

fastlegen
rss-civitapodden
romkapsel
jss
tingenes-tilstand
forskningno
sinnsyn
vett-og-vitenskap-med-gaute-einevoll
rss-paradigmepodden
rekommandert
fjellsportpodden
dekodet-2
rss-rekommandert
villmarksliv
tidlose-historier
rss-alt-forklart-for-barn
diagnose
hva-er-greia-med
rss-lundqvist-podden
rss-zahid-ali-hjelper-deg