An Agentic Mixture of Experts for DevOps with Sunil Mallya - #708

An Agentic Mixture of Experts for DevOps with Sunil Mallya - #708

Today we're joined by Sunil Mallya, CTO and co-founder of Flip AI. We discuss Flip’s incident debugging system for DevOps, which was built using a custom mixture of experts (MoE) large language model (LLM) trained on a novel "CoMELT" observability dataset which combines traditional MELT data—metrics, events, logs, and traces—with code to efficiently identify root failure causes in complex software systems. We discuss the challenges of integrating time-series data with LLMs and their multi-decoder architecture designed for this purpose. Sunil describes their system's agent-based design, focusing on clear roles and boundaries to ensure reliability. We examine their "chaos gym," a reinforcement learning environment used for testing and improving the system's robustness. Finally, we discuss the practical considerations of deploying such a system at scale in diverse environments and much more. The complete show notes for this episode can be found at https://twimlai.com/go/708.

Jaksot(781)

Fast Radio Burst Pulse Detection with Gerry Zhang - TWIML Talk #278

Fast Radio Burst Pulse Detection with Gerry Zhang - TWIML Talk #278

Today we’re joined by Yunfan Gerry Zhang, a PhD student at UC Berkely, and an affiliate of Berkeley’s SETI research center. In our conversation, we discuss:  • Gerry's research on applying machine le...

27 Kesä 201938min

Tracking CO2 Emissions with Machine Learning with Laurence Watson - TWIML Talk #277

Tracking CO2 Emissions with Machine Learning with Laurence Watson - TWIML Talk #277

Today we’re joined by Laurence Watson, Co-Founder and CTO of Plentiful Energy and a former data scientist at Carbon Tracker. In our conversation, we discuss: • Carbon Tracker's goals, and their repor...

24 Kesä 201941min

Topic Modeling for Customer Insights at USAA with William Fehlman - TWIML Talk #276

Topic Modeling for Customer Insights at USAA with William Fehlman - TWIML Talk #276

Today we’re joined by William Fehlman, director of data science at USAA, to discuss: • His work on topic modeling, which USAA uses in various scenarios, including member chat channels. • How their ...

20 Kesä 201944min

Phronesis of AI in Radiology with Judy Gichoya - TWIML Talk #275

Phronesis of AI in Radiology with Judy Gichoya - TWIML Talk #275

Today we’re joined by Judy Gichoya an interventional radiology fellow at the Dotter Institute at Oregon Health and Science University. In our conversation, we discuss: • Judy's research on the paper ...

18 Kesä 201943min

The Ethics of AI-Enabled Surveillance with Karen Levy - TWIML Talk #274

The Ethics of AI-Enabled Surveillance with Karen Levy - TWIML Talk #274

Today we’re joined by Karen Levy, assistant professor in the department of information science at Cornell University. Karen’s research focuses on how rules and technologies interact to regulate behavi...

14 Kesä 201943min

Supporting Rapid Model Development at Two Sigma with Matt Adereth & Scott Clark - TWIML Talk #273

Supporting Rapid Model Development at Two Sigma with Matt Adereth & Scott Clark - TWIML Talk #273

Today we’re joined by Matt Adereth, managing director of investments at Two Sigma, and return guest Scott Clark, co-founder and CEO of SigOpt, to discuss: • The end to end modeling platform at Two Si...

11 Kesä 201946min

Scaling Model Training with Kubernetes at Stripe with Kelley Rivoire - TWIML Talk #272

Scaling Model Training with Kubernetes at Stripe with Kelley Rivoire - TWIML Talk #272

Today we’re joined by Kelley Rivoire, engineering manager working on machine learning infrastructure at Stripe. Kelley and I caught up at a recent Strata Data conference to discuss: • Her talk "Scali...

6 Kesä 201942min

Productizing ML at Scale at Twitter with Yi Zhuang - TWIML Talk #271

Productizing ML at Scale at Twitter with Yi Zhuang - TWIML Talk #271

Today we continue our AI Platforms series joined by Yi Zhuang, Senior Staff Engineer at Twitter. In our conversation, we cover:  • The machine learning landscape at Twitter, including with the histor...

3 Kesä 201946min

Suosittua kategoriassa Politiikka ja uutiset

uutiscast
aikalisa
rss-ootsa-kuullut-tasta
politiikan-puskaradio
ootsa-kuullut-tasta-2
tervo-halme
viisupodi
rss-vaalirankkurit-podcast
rss-podme-livebox
rss-asiastudio
rikosmyytit
the-ulkopolitist
et-sa-noin-voi-sanoo-esittaa
otetaan-yhdet
io-techin-tekniikkapodcast
linda-maria
radio-antro
rss-sanna-ukkola-show-verkkouutiset
aihe
rss-tasta-on-kyse-ivan-puopolo-verkkouutiset