#281 Leon Song: The Research Driving Next-Gen Open-Source Models (Together AI)
Eye On A.I.25 Aug 2025

#281 Leon Song: The Research Driving Next-Gen Open-Source Models (Together AI)

AGNTCY - Unlock agents at scale with an open Internet of Agents. Visit https://agntcy.org/ and add your support.


In this episode of Eye on AI, we sit down with Leon Song, VP of Research at Together AI, to explore how open-source models and cutting-edge infrastructure are reshaping the AI landscape.

From speculative decoding to FlashAttention and RedPajama, Leon shares how Together AI is building one of the fastest, most cost-efficient AI clouds—helping enterprises fine-tune, deploy, and scale open-source models at the level of GPT-4 and beyond.

We dive into Leon's journey from leading DeepSpeed and AI for Science at Microsoft to driving system-level innovation at Together AI.

Topics include:

  • The future of open-source vs. closed-source AI models

  • Breakthroughs in speculative decoding for faster inference

  • How Together AI's cloud platform empowers enterprises with data sovereignty and model ownership

  • Why open-source models like DeepSeek R1 and Llama 4 are now rivaling proprietary systems

  • The role of GPUs vs. ASIC accelerators in scaling AI infrastructure

Whether you're an AI researcher, enterprise leader, or curious about where generative AI is heading, this conversation reveals the technology and strategy behind one of the most important players in the open-source AI movement.

Stay Updated:

Craig Smith on X:https://x.com/craigss

Eye on A.I. on X: https://x.com/EyeOn_AI

Denne episoden er hentet fra en åpen RSS-feed og er ikke publisert av Podme. Den kan derfor inneholde annonser.

Episoder(353)

Every Enterprise Is About to Have a 100,000 Agent Problem | Oren Michaels of Barndoor AI

Every Enterprise Is About to Have a 100,000 Agent Problem | Oren Michaels of Barndoor AI

AI agents can now connect to every tool your employees use. The problem is that connecting them and trusting them are two completely different things, and most enterprises have figured out the first w...

6 Jun 59min

More Customers Chose the AI Agent Than Anyone Expected | Tom Chen, Aircall

More Customers Chose the AI Agent Than Anyone Expected | Tom Chen, Aircall

Every time you hit a phone tree or a chatbot with canned answers, you're experiencing the gap between what AI can already do and what most companies are still delivering. Craig Smith sits down with To...

4 Jun 56min

Why the Future of AI Isn't Just Bigger Models. It's Models That Evolve | Risto Miikkulainen of Cognizant

Why the Future of AI Isn't Just Bigger Models. It's Models That Evolve | Risto Miikkulainen of Cognizant

Most AI systems follow a gradient, a mathematical slope that tells them exactly how to improve, step by step, toward a known goal. Neuroevolution doesn't follow any gradient. Instead, it runs hundreds...

2 Jun 1h 4min

How AI Is Reinventing Elder Care | Chia-Lin Simmons of LogicMark

How AI Is Reinventing Elder Care | Chia-Lin Simmons of LogicMark

One in four people over 65 will experience a fall, and for most of them, the technology designed to help is a device that hasn't meaningfully changed since the 1980s. Chia-Lin Simmons, CEO of LogicMar...

1 Jun 53min

The App of the Future Is Voice — Not a Screen. Mitel's CTO Luiz Domingos Explains Why.

The App of the Future Is Voice — Not a Screen. Mitel's CTO Luiz Domingos Explains Why.

Luiz Domingos has spent 25 years watching enterprise communications evolve, from IP telephony to cloud to AI, and his assessment of where things stand now is unusually concrete. Companies have moved p...

28 Mai 54min

Is ChatGPT Conscious? A Pioneer of AI Explains | Dr. Terry Sejnowski

Is ChatGPT Conscious? A Pioneer of AI Explains | Dr. Terry Sejnowski

A fly with 100,000 neurons can fly, find food, and reproduce. A $100 million supercomputer cannot. Dr. Terry Sejnowski used that observation to silence a room full of MIT AI researchers in the 1980s, ...

28 Mai 56min

Your Child's Data Profile Starts Before They're Born | Eamonn Maguire of Proton

Your Child's Data Profile Starts Before They're Born | Eamonn Maguire of Proton

Your child's data profile doesn't start when they get their first phone. It starts before they're born, the moment a parent emails a gynecologist or visits a fertility clinic website. That's the core ...

28 Mai 55min

Training AI Models Without a Billion-Dollar Data Center | Steffen Cruz of Macrocosmos

Training AI Models Without a Billion-Dollar Data Center | Steffen Cruz of Macrocosmos

Training a frontier AI model today requires hundreds of thousands of GPUs, months of compute time, and a budget that only a handful of companies on earth can afford. Steffen Cruz, co-founder and CTO o...

25 Mai 47min

Populært innen Teknologi

lydartikler-fra-aftenposten
romkapsel
teknisk-sett
energi-og-klima
elektropodden
nasjonal-sikkerhetsmyndighet-nsm
tomprat-med-gunnar-tjomlid
shifter
fornybaren
hans-petter-og-co
teknologi-og-mennesker
rss-ki-praten
i-loopen
rss-heis
rss-ai-forklart
rss-for-alarmen-gar
rss-alt-som-gar-pa-strom
rss-digitaliseringspadden
rss-bouvet-bobler
rss-startup