Ronen Dar on GPU Orchestration for Building ML Models
Data Driven5 Feb 2024

Ronen Dar on GPU Orchestration for Building ML Models

In this episode, our Andy Leonard and Frank La Vigne sit down with Ronen Dar, the co-founder and CTO of Run AI, to explore the world of artificial intelligence and GPU orchestration for machine learning models.

Ronen shares insights into the challenges of utilizing GPUs in AI research and how Run AI's platform addresses these issues by optimizing GPU usage and providing tools for easier and faster model training and deployment. The conversation delves into the concept of fractional GPU usage, allowing multiple workloads to run on a single GPU, making expensive GPUs more accessible and cost-effective for organizations.

Links
Show Notes

04:40 GPU technology enabled for cloud AI workloads.

07:00 RunAI enables sharing expensive GPU resources for all.

11:59 As enterprise AI matures, organizations become more savvy.

15:35 Deep learning, GPUs for speed, CPUs backup.

16:54 LLMs running on GPU's, exploding in market.

23:29 NVIDIA created CUDA to simplify GPU use.

26:21 NVIDIA's success lies in accessible technology.

28:25 Solve GPU hugging with quotas and sharing.

31:15 Team lead manages GPU quotas for researchers.

35:51 Rapid changes in business and innovation.

40:34 Passionate problem-solver with diverse tech background.

43:38 Thanks for tuning in, subscribe and review.

Episoder(300)

Christopher Nuland on Stacking Servers & Superintelligence: Hype and Reality Behind AI 2027

Christopher Nuland on Stacking Servers & Superintelligence: Hype and Reality Behind AI 2027

Welcome to another episode of Data Driven—the podcast where we explore the future of technology, one neural network at a time. In this episode, your hosts Frank La Vigne and Bailey are joined by Chris...

15 Jul 202543min

Amir Berman on Making Construction Smarter with AI and Analytics

Amir Berman on Making Construction Smarter with AI and Analytics

In this episode, host Frank La Vigne is joined by Amir Berman, VP of Industry Transformation at Buildots, to explore how AI, computer vision, and cutting-edge analytics are revolutionizing the constru...

13 Jun 20251h 1min

The AI Driven Leader: Rethinking Strategy, Decision Making, and Personal Growth

The AI Driven Leader: Rethinking Strategy, Decision Making, and Personal Growth

Welcome to the season nine premiere of Data Driven, where we kick things off with a thought-provoking deep dive into the world of AI-powered leadership. In this episode, hosts Frank La Vigne, Andy Leo...

22 Mai 202557min

*Special Announcement* From 386 Computers to AI Leadership: Our Season Nine Kickoff

*Special Announcement* From 386 Computers to AI Leadership: Our Season Nine Kickoff

Andy and I are kicking off Season Nine of Data Driven with a bang: an insightful interview with Jeff Woods, author of “The AI Driven Leader.”Andy, Bailey, and I are thrilled to bring you brand-new con...

21 Mai 202530s

Jacob Leverich on Efficiency, Elegance, and the Joy of Not Grepping log files at 2AM

Jacob Leverich on Efficiency, Elegance, and the Joy of Not Grepping log files at 2AM

This week, Frank sat down with Dr. Jacob Leverich—Stanford PhD, cofounder of Observe, and a veteran of the Google MapReduce team and Splunk. Jacob’s journey, from tinkering with video game code as a k...

22 Apr 202558min

István Mészáros on going From CERN to Startup & The Cat That Launched a Thousand Queries

István Mészáros on going From CERN to Startup & The Cat That Launched a Thousand Queries

Welcome to another insightful episode of Data Driven! Today, we're diving into the world of warehouse-native analytics with our special guest, István Mészáros, cofounder of Mitsu. Join us as we explor...

14 Apr 202558min

Barr Moses on How Data Observability Can Save Your Company Millions

Barr Moses on How Data Observability Can Save Your Company Millions

On this episode of Data Driven, we welcome Barr Moses, CEO and co-founder of Monte Carlo, as she delves into the fascinating world of data observability. Join hosts Frank La Vigne and Andy Leonard as ...

1 Apr 202554min

Sanjay Annadate on Data Driven Digital Transformation

Sanjay Annadate on Data Driven Digital Transformation

In this episode, Sanjay joins Frank for a deep dive into the heart of digital transformation and AI-powered automation. Here are some of the key takeaways:Digital Transformation Evolution: Sanjay refl...

4 Mar 202545min

Populært innen Vitenskap

fastlegen
tingenes-tilstand
jss
rekommandert
forskningno
sinnsyn
tomprat-med-gunnar-tjomlid
villmarksliv
rss-paradigmepodden
rss-nysgjerrige-norge
liberal-halvtime
nevropodden
fjellsportpodden
kvinnehelsepodden
diagnose
tidlose-historier
rss-inn-til-kjernen-med-sunniva-rose
psykopoden
nordnorsk-historie
rss-hoyt-lavt-med-ida-tonseth