Ronen Dar on GPU Orchestration for Building ML Models
Data Driven5 Helmi 2024

Ronen Dar on GPU Orchestration for Building ML Models

In this episode, our Andy Leonard and Frank La Vigne sit down with Ronen Dar, the co-founder and CTO of Run AI, to explore the world of artificial intelligence and GPU orchestration for machine learning models.

Ronen shares insights into the challenges of utilizing GPUs in AI research and how Run AI's platform addresses these issues by optimizing GPU usage and providing tools for easier and faster model training and deployment. The conversation delves into the concept of fractional GPU usage, allowing multiple workloads to run on a single GPU, making expensive GPUs more accessible and cost-effective for organizations.

Links
Show Notes

04:40 GPU technology enabled for cloud AI workloads.

07:00 RunAI enables sharing expensive GPU resources for all.

11:59 As enterprise AI matures, organizations become more savvy.

15:35 Deep learning, GPUs for speed, CPUs backup.

16:54 LLMs running on GPU's, exploding in market.

23:29 NVIDIA created CUDA to simplify GPU use.

26:21 NVIDIA's success lies in accessible technology.

28:25 Solve GPU hugging with quotas and sharing.

31:15 Team lead manages GPU quotas for researchers.

35:51 Rapid changes in business and innovation.

40:34 Passionate problem-solver with diverse tech background.

43:38 Thanks for tuning in, subscribe and review.

Jaksot(300)

Dean Guida on AI Insights, Data Analytics, and Business Growth

Dean Guida on AI Insights, Data Analytics, and Business Growth

Today, we've got an exciting episode lined up for you. Hosts Frank La Vigne and Bailey dive deep into the tech universe with Dean Guida, the CEO and founder of Infragistics. Dean brings his 35-year jo...

28 Tammi 20251h 1min

Arjun Patel on Vector Databases and the Future of Semantic Search

Arjun Patel on Vector Databases and the Future of Semantic Search

Today, we delve into the intriguing world of vector databases, retrieval augmented generation, and a surprising twist—origami.Our special guest, Arjun Patel, a developer advocate at Pinecone, will be ...

21 Tammi 202551min

Niv Braun on AI Security Measures and Emerging Threats

Niv Braun on AI Security Measures and Emerging Threats

In today's episode, we're thrilled to have Niv Braun, co-founder and CEO of Noma Security, join us as we tackle some pressing issues in AI security.With the rapid adoption of generative AI technologie...

14 Tammi 202553min

*Live* Tis the Season for SSIS

*Live* Tis the Season for SSIS

In this livestream, Frank and Andy discuss the timeless nature of backend enterprise tech, that, much like a Christmas special from decades ago, is still very much celebrated.Moments00:00 Exploring SS...

24 Joulu 20241h 34min

Inna Tokarev Sela on Approaching Data Challenges with Generative AI

Inna Tokarev Sela on Approaching Data Challenges with Generative AI

Welcome to another episode of "Data Driven," where we dive into the ever-evolving world of data science, AI, and data engineering. Today's special guest is Inna Tokarev Sela, CEO and founder of Illumi...

18 Joulu 202458min

Geoff Thatcher on How AI is Revolutionizing Storytelling

Geoff Thatcher on How AI is Revolutionizing Storytelling

Joining hosts Frank La Vigne and Andy Leonard, Geoff shares insights on the intersection of AI and creativity, the evolving landscape of careers in the age of artificial intelligence, and the crucial ...

3 Joulu 20241h 5min

Alex Gold on DevOps for Data Science and Open Source Practices

Alex Gold on DevOps for Data Science and Open Source Practices

Frank La Vigne sits down with Alex Gold, Head of Solutions Engineering at POSIT and author of "DevOps for Data Science." Together, they explore the fascinating intersections of DevOps, MLOps, and gene...

25 Marras 202459min

David Hirschfeld on Creating High-Impact Teams & Validating Niches

David Hirschfeld on Creating High-Impact Teams & Validating Niches

Today, Frank and Andy are joined by David Hirschfeld, CEO and founder of Tekyz Corporation, a firm specializing in helping startups and saving troubled projects with his unique "Launch First" methodol...

18 Marras 202452min

Suosittua kategoriassa Tiede

tiedekulma-podcast
rss-poliisin-mieli
rss-mita-tulisi-tietaa
docemilia
rss-duodecim-lehti
rss-luontopodi-samuel-glassar-tutkii-luonnon-ihmeita
utelias-mieli
radio-antro
rss-astetta-parempi-elama-podcast
rss-lapsuuden-rakentajat-podcast
rss-lihavuudesta-podcast
rss-sosiopodi