An Agentic Mixture of Experts for DevOps with Sunil Mallya - #708

An Agentic Mixture of Experts for DevOps with Sunil Mallya - #708

Today we're joined by Sunil Mallya, CTO and co-founder of Flip AI. We discuss Flip’s incident debugging system for DevOps, which was built using a custom mixture of experts (MoE) large language model (LLM) trained on a novel "CoMELT" observability dataset which combines traditional MELT data—metrics, events, logs, and traces—with code to efficiently identify root failure causes in complex software systems. We discuss the challenges of integrating time-series data with LLMs and their multi-decoder architecture designed for this purpose. Sunil describes their system's agent-based design, focusing on clear roles and boundaries to ensure reliability. We examine their "chaos gym," a reinforcement learning environment used for testing and improving the system's robustness. Finally, we discuss the practical considerations of deploying such a system at scale in diverse environments and much more. The complete show notes for this episode can be found at https://twimlai.com/go/708.

Avsnitt(781)

Reinforcement Learning for Industrial AI with Pieter Abbeel - #476

Reinforcement Learning for Industrial AI with Pieter Abbeel - #476

Today we’re joined by Pieter Abbeel, a Professor at UC Berkeley, co-Director of the Berkeley AI Research Lab (BAIR), as well as Co-founder and Chief Scientist at Covariant. In our conversation with P...

19 Apr 202158min

AutoML for Natural Language Processing with Abhishek Thakur - #475

AutoML for Natural Language Processing with Abhishek Thakur - #475

Today we’re joined by Abhishek Thakur, a machine learning engineer at Hugging Face, and the world’s first Quadruple Kaggle Grandmaster! In our conversation with Abhishek, we explore his Kaggle journe...

15 Apr 202136min

Inclusive Design for Seeing AI with Saqib Shaikh - #474

Inclusive Design for Seeing AI with Saqib Shaikh - #474

Today we’re joined by Saqib Shaikh, a Software Engineer at Microsoft, and the lead for the Seeing AI Project. In our conversation with Saqib, we explore the Seeing AI app, an app “that narrates the w...

12 Apr 202135min

Theory of Computation with Jelani Nelson - #473

Theory of Computation with Jelani Nelson - #473

Today we’re joined by Jelani Nelson, a professor in the Theory Group at UC Berkeley. In our conversation with Jelani, we explore his research in computational theory, where he focuses on building str...

8 Apr 202133min

Human-Centered ML for High-Risk Behaviors with Stevie Chancellor - #472

Human-Centered ML for High-Risk Behaviors with Stevie Chancellor - #472

Today we’re joined by Stevie Chancellor, an Assistant Professor in the Department of Computer Science and Engineering at the University of Minnesota. In our conversation with Stevie, we explore her w...

5 Apr 202140min

Operationalizing AI at Dataiku with Conor Jensen - #471

Operationalizing AI at Dataiku with Conor Jensen - #471

In this episode, we’re joined by Dataiku’s Director of Data Science, Conor Jensen. In our conversation, we explore the panel he lead at TWIMLcon “AI Operationalization: Where the AI Rubber Hits the Ro...

1 Apr 202123min

ML Lifecycle Management at Algorithmia with Diego Oppenheimer - #470

ML Lifecycle Management at Algorithmia with Diego Oppenheimer - #470

In this episode, we’re joined by Diego Oppenheimer, Founder and CEO of Algorithmia. In our conversation, we discuss Algorithmia’s involvement with TWIMLcon, as well as an exploration of the results of...

1 Apr 202126min

End to End ML at Cloudera with Santiago Giraldo - #469 [TWIMLcon Sponsor Series]

End to End ML at Cloudera with Santiago Giraldo - #469 [TWIMLcon Sponsor Series]

In this episode, we’re joined by Santiago Giraldo, Director Of Product Marketing for Data Engineering & Machine Learning at Cloudera. In our conversation, we discuss Cloudera’s talks at TWIMLcon, as w...

29 Mars 202122min

Populärt inom Politik & nyheter

svenska-fall
aftonbladet-krim
p3-krim
rss-krimstad
fordomspodden
flashback-forever
motiv
rss-sanning-konsekvens
aftonbladet-daily
blenda-2
spar
rss-krimreportrarna
svd-ledarredaktionen
olyckan-inifran
rss-frandfors-horna
rss-vad-fan-hande
rss-flodet
dagens-eko
krimmagasinet
politiken