An Agentic Mixture of Experts for DevOps with Sunil Mallya - #708

An Agentic Mixture of Experts for DevOps with Sunil Mallya - #708

Today we're joined by Sunil Mallya, CTO and co-founder of Flip AI. We discuss Flip’s incident debugging system for DevOps, which was built using a custom mixture of experts (MoE) large language model (LLM) trained on a novel "CoMELT" observability dataset which combines traditional MELT data—metrics, events, logs, and traces—with code to efficiently identify root failure causes in complex software systems. We discuss the challenges of integrating time-series data with LLMs and their multi-decoder architecture designed for this purpose. Sunil describes their system's agent-based design, focusing on clear roles and boundaries to ensure reliability. We examine their "chaos gym," a reinforcement learning environment used for testing and improving the system's robustness. Finally, we discuss the practical considerations of deploying such a system at scale in diverse environments and much more. The complete show notes for this episode can be found at https://twimlai.com/go/708.

Jaksot(781)

Predictive Maintenance Using Deep Learning and Reliability Engineering with Shayan Mortazavi - #540

Predictive Maintenance Using Deep Learning and Reliability Engineering with Shayan Mortazavi - #540

Today we’re joined by Shayan Mortazavi, a data science manager at Accenture.  In our conversation with Shayan, we discuss his talk from the recent SigOpt HPC & AI Summit, titled A Novel Framework Pred...

29 Marras 202149min

Building a Deep Tech Startup in NLP with Nasrin Mostafazadeh - #539

Building a Deep Tech Startup in NLP with Nasrin Mostafazadeh - #539

Today we’re joined by friend-of-the-show Nasrin Mostafazadeh, co-founder of Verneek.  Though Verneek is still in stealth, Nasrin was gracious enough to share a bit about the company, including their g...

24 Marras 202151min

Models for Human-Robot Collaboration with Julie Shah - #538

Models for Human-Robot Collaboration with Julie Shah - #538

Today we’re joined by Julie Shah, a professor at the Massachusetts Institute of Technology (MIT). Julie’s work lies at the intersection of aeronautics, astronautics, and robotics, with a specific focu...

22 Marras 202142min

Four Key Tools for Robust Enterprise NLP with Yunyao Li - #537

Four Key Tools for Robust Enterprise NLP with Yunyao Li - #537

Today we’re joined by Yunyao Li, a senior research manager at IBM Research.  Yunyao is in a somewhat unique position at IBM, addressing the challenges of enterprise NLP in a traditional research envir...

18 Marras 202158min

Machine Learning at GSK with Kim Branson - #536

Machine Learning at GSK with Kim Branson - #536

Today we’re joined by Kim Branson, the SVP and global head of artificial intelligence and machine learning at GSK.  We cover a lot of ground in our conversation, starting with a breakdown of GSK’s cor...

15 Marras 20211h

The Benefit of Bottlenecks in Evolving Artificial Intelligence with David Ha - #535

The Benefit of Bottlenecks in Evolving Artificial Intelligence with David Ha - #535

Today we’re joined by David Ha, a research scientist at Google.  In nature, there are many examples of “bottlenecks”, or constraints, that have shaped our development as a species. Building upon this ...

11 Marras 202159min

Facebook Abandons Facial Recognition. Should Everyone Else Follow Suit? With Luke Stark - #534

Facebook Abandons Facial Recognition. Should Everyone Else Follow Suit? With Luke Stark - #534

Today we’re joined by Luke Stark, an assistant professor at Western University in London, Ontario.  In our conversation with Luke, we explore the existence and use of facial recognition technology, so...

8 Marras 202142min

Building Blocks of Machine Learning at LEGO with Francesc Joan Riera - #533

Building Blocks of Machine Learning at LEGO with Francesc Joan Riera - #533

Today we’re joined by Francesc Joan Riera, an applied machine learning engineer at The LEGO Group.  In our conversation, we explore the ML infrastructure at LEGO, specifically around two use cases, c...

4 Marras 202143min

Suosittua kategoriassa Politiikka ja uutiset

uutiscast
aikalisa
rss-ootsa-kuullut-tasta
politiikan-puskaradio
ootsa-kuullut-tasta-2
tervo-halme
viisupodi
rss-podme-livebox
rss-asiastudio
rikosmyytit
the-ulkopolitist
et-sa-noin-voi-sanoo-esittaa
otetaan-yhdet
radio-antro
rss-sanna-ukkola-show-verkkouutiset
io-techin-tekniikkapodcast
aihe
rss-tasta-on-kyse-ivan-puopolo-verkkouutiset
rss-kyselytunti
rss-tekkipodi