An Agentic Mixture of Experts for DevOps with Sunil Mallya - #708

An Agentic Mixture of Experts for DevOps with Sunil Mallya - #708

Today we're joined by Sunil Mallya, CTO and co-founder of Flip AI. We discuss Flip’s incident debugging system for DevOps, which was built using a custom mixture of experts (MoE) large language model (LLM) trained on a novel "CoMELT" observability dataset which combines traditional MELT data—metrics, events, logs, and traces—with code to efficiently identify root failure causes in complex software systems. We discuss the challenges of integrating time-series data with LLMs and their multi-decoder architecture designed for this purpose. Sunil describes their system's agent-based design, focusing on clear roles and boundaries to ensure reliability. We examine their "chaos gym," a reinforcement learning environment used for testing and improving the system's robustness. Finally, we discuss the practical considerations of deploying such a system at scale in diverse environments and much more. The complete show notes for this episode can be found at https://twimlai.com/go/708.

Avsnitt(781)

Fast Radio Burst Pulse Detection with Gerry Zhang - TWIML Talk #278

Fast Radio Burst Pulse Detection with Gerry Zhang - TWIML Talk #278

Today we’re joined by Yunfan Gerry Zhang, a PhD student at UC Berkely, and an affiliate of Berkeley’s SETI research center. In our conversation, we discuss:  • Gerry's research on applying machine le...

27 Juni 201938min

Tracking CO2 Emissions with Machine Learning with Laurence Watson - TWIML Talk #277

Tracking CO2 Emissions with Machine Learning with Laurence Watson - TWIML Talk #277

Today we’re joined by Laurence Watson, Co-Founder and CTO of Plentiful Energy and a former data scientist at Carbon Tracker. In our conversation, we discuss: • Carbon Tracker's goals, and their repor...

24 Juni 201941min

Topic Modeling for Customer Insights at USAA with William Fehlman - TWIML Talk #276

Topic Modeling for Customer Insights at USAA with William Fehlman - TWIML Talk #276

Today we’re joined by William Fehlman, director of data science at USAA, to discuss: • His work on topic modeling, which USAA uses in various scenarios, including member chat channels. • How their ...

20 Juni 201944min

Phronesis of AI in Radiology with Judy Gichoya - TWIML Talk #275

Phronesis of AI in Radiology with Judy Gichoya - TWIML Talk #275

Today we’re joined by Judy Gichoya an interventional radiology fellow at the Dotter Institute at Oregon Health and Science University. In our conversation, we discuss: • Judy's research on the paper ...

18 Juni 201943min

The Ethics of AI-Enabled Surveillance with Karen Levy - TWIML Talk #274

The Ethics of AI-Enabled Surveillance with Karen Levy - TWIML Talk #274

Today we’re joined by Karen Levy, assistant professor in the department of information science at Cornell University. Karen’s research focuses on how rules and technologies interact to regulate behavi...

14 Juni 201943min

Supporting Rapid Model Development at Two Sigma with Matt Adereth & Scott Clark - TWIML Talk #273

Supporting Rapid Model Development at Two Sigma with Matt Adereth & Scott Clark - TWIML Talk #273

Today we’re joined by Matt Adereth, managing director of investments at Two Sigma, and return guest Scott Clark, co-founder and CEO of SigOpt, to discuss: • The end to end modeling platform at Two Si...

11 Juni 201946min

Scaling Model Training with Kubernetes at Stripe with Kelley Rivoire - TWIML Talk #272

Scaling Model Training with Kubernetes at Stripe with Kelley Rivoire - TWIML Talk #272

Today we’re joined by Kelley Rivoire, engineering manager working on machine learning infrastructure at Stripe. Kelley and I caught up at a recent Strata Data conference to discuss: • Her talk "Scali...

6 Juni 201942min

Productizing ML at Scale at Twitter with Yi Zhuang - TWIML Talk #271

Productizing ML at Scale at Twitter with Yi Zhuang - TWIML Talk #271

Today we continue our AI Platforms series joined by Yi Zhuang, Senior Staff Engineer at Twitter. In our conversation, we cover:  • The machine learning landscape at Twitter, including with the histor...

3 Juni 201946min

Populärt inom Politik & nyheter

aftonbladet-krim
svenska-fall
p3-krim
rss-krimstad
fordomspodden
flashback-forever
motiv
aftonbladet-daily
rss-sanning-konsekvens
blenda-2
spar
rss-expressen-dok
rss-krimreportrarna
rss-vad-fan-hande
svd-ledarredaktionen
olyckan-inifran
rss-frandfors-horna
rss-flodet
dagens-eko
krimmagasinet