An Agentic Mixture of Experts for DevOps with Sunil Mallya - #708

An Agentic Mixture of Experts for DevOps with Sunil Mallya - #708

Today we're joined by Sunil Mallya, CTO and co-founder of Flip AI. We discuss Flip’s incident debugging system for DevOps, which was built using a custom mixture of experts (MoE) large language model (LLM) trained on a novel "CoMELT" observability dataset which combines traditional MELT data—metrics, events, logs, and traces—with code to efficiently identify root failure causes in complex software systems. We discuss the challenges of integrating time-series data with LLMs and their multi-decoder architecture designed for this purpose. Sunil describes their system's agent-based design, focusing on clear roles and boundaries to ensure reliability. We examine their "chaos gym," a reinforcement learning environment used for testing and improving the system's robustness. Finally, we discuss the practical considerations of deploying such a system at scale in diverse environments and much more. The complete show notes for this episode can be found at https://twimlai.com/go/708.

Episoder(780)

Building Conversational Application for Financial Services with Kenneth Conroy - TWiML Talk #61

Building Conversational Application for Financial Services with Kenneth Conroy - TWiML Talk #61

The podcast you’re about to hear is the second of a series of shows recorded at the Georgian Partners Portfolio Conference last week in Toronto. My guest for this interview is Kenneth Conroy, VP of da...

1 Nov 201737min

Fighting Fraud with Machine Learning at Shopify with Solmaz Shahalizadeh - TWiML Talk #60

Fighting Fraud with Machine Learning at Shopify with Solmaz Shahalizadeh - TWiML Talk #60

The podcast you’re about to hear is the first of a series of shows recorded at the Georgian Partners Portfolio Conference last week in Toronto. My guest for this show is Solmaz Shahalizadeh, Director ...

30 Okt 201735min

Modeling Human Drivers for Autonomous Vehicles with Katie Driggs-Campbell - TWiML Talk #59

Modeling Human Drivers for Autonomous Vehicles with Katie Driggs-Campbell - TWiML Talk #59

We are back with our third show this week, episode 3 of our Autonomous Vehicles Series. My guest this time is Katie Driggs-Campbell, PostDoc in the Intelligent Systems Lab at Stanford University’s Dep...

27 Okt 201733min

Perception Models for Self-Driving Cars with Jianxiong Xiao - TWiML Talk #58

Perception Models for Self-Driving Cars with Jianxiong Xiao - TWiML Talk #58

We are back with our second show this week, episode 2 of our Autonomous Vehicles Series. This time around we are joined by Jianxiong Xiao of AutoX, a company building computer vision centric solutions...

25 Okt 201741min

Training Data for Autonomous Vehicles - Daryn Nakhuda - TWiML Talk #57

Training Data for Autonomous Vehicles - Daryn Nakhuda - TWiML Talk #57

The episode you are about to hear is the first of a new series of shows on Autonomous Vehicles. We all know that self-driving cars is one of the hottest topics in ML & AI, so we had to dig a little de...

23 Okt 201747min

Human Factors in Machine Intelligence with James Guszcza - TWiML Talk #56

Human Factors in Machine Intelligence with James Guszcza - TWiML Talk #56

As you all know, a few weeks ago, I spent some time in SF at the Artificial Intelligence Conference. I sat down with James Guszcza, US Chief Data Scientist at Deloitte Consulting to talk about human f...

16 Okt 201742min

AI-Powered Conversational Interfaces with Paul Tepper - TWiML Talk #52

AI-Powered Conversational Interfaces with Paul Tepper - TWiML Talk #52

The show you’re about to hear is part of a series of shows recorded in San Francisco at the Artificial Intelligence Conference. My guest for this show is Paul Tepper, worldwide head of cognitive innov...

6 Okt 201736min

ML Use Cases at Think Big Analytics with Mo Patel and Laura Frølich - TWiML Talk #54

ML Use Cases at Think Big Analytics with Mo Patel and Laura Frølich - TWiML Talk #54

The show you’re about to hear is part of a series of shows recorded in San Francisco at the Artificial Intelligence Conference. This time around, I speak with Mo Patel, practice director of AI & deep ...

6 Okt 201745min

Populært innen Politikk og nyheter

giver-og-gjengen-vg
aftenpodden-usa
aftenpodden
forklart
stopp-verden
popradet
i-retten
lydartikler-fra-aftenposten
det-store-bildet
dine-penger-pengeradet
rss-gukild-johaug
nokon-ma-ga
rss-ness
fotballpodden-2
hanna-de-heldige
aftenbla-bla
rss-dannet-uten-piano
frokostshowet-pa-p5
rss-penger-polser-og-politikk
unitedno