An Agentic Mixture of Experts for DevOps with Sunil Mallya - #708

An Agentic Mixture of Experts for DevOps with Sunil Mallya - #708

Today we're joined by Sunil Mallya, CTO and co-founder of Flip AI. We discuss Flip’s incident debugging system for DevOps, which was built using a custom mixture of experts (MoE) large language model (LLM) trained on a novel "CoMELT" observability dataset which combines traditional MELT data—metrics, events, logs, and traces—with code to efficiently identify root failure causes in complex software systems. We discuss the challenges of integrating time-series data with LLMs and their multi-decoder architecture designed for this purpose. Sunil describes their system's agent-based design, focusing on clear roles and boundaries to ensure reliability. We examine their "chaos gym," a reinforcement learning environment used for testing and improving the system's robustness. Finally, we discuss the practical considerations of deploying such a system at scale in diverse environments and much more. The complete show notes for this episode can be found at https://twimlai.com/go/708.

Jaksot(781)

cuDF, cuML & RAPIDS: GPU Accelerated Data Science with Paul Mahler - TWiML Talk #254

cuDF, cuML & RAPIDS: GPU Accelerated Data Science with Paul Mahler - TWiML Talk #254

Today we're joined by Paul Mahler, senior data scientist and technical product manager for ML at NVIDIA. In our conversation, Paul and I discuss NVIDIA's RAPIDS open source project, which aims to br...

19 Huhti 201938min

Edge AI for Smart Manufacturing with Trista Chen - TWiML Talk #253

Edge AI for Smart Manufacturing with Trista Chen - TWiML Talk #253

Today we’re joined by Trista Chen, chief scientist of machine learning at Inventec, who spoke on “Edge AI in Smart Manufacturing: Defect Detection and Beyond” at GTC. In our conversation, we discuss t...

18 Huhti 201938min

Machine Learning for Security and Security for Machine Learning with Nicole Nichols - TWiML Talk #252

Machine Learning for Security and Security for Machine Learning with Nicole Nichols - TWiML Talk #252

Today we’re joined by Nicole Nichols, a senior research scientist at the Pacific Northwest National Lab. We discuss her recent presentation at GTC, which was titled “Machine Learning for Security, and...

16 Huhti 201941min

Domain Adaptation and Generative Models for Single Cell Genomics with Gerald Quon - TWiML Talk #251

Domain Adaptation and Generative Models for Single Cell Genomics with Gerald Quon - TWiML Talk #251

Today we’re joined by Gerald Quon, assistant professor at UC Davis. Gerald presented his work on Deep Domain Adaptation and Generative Models for Single Cell Genomics at GTC this year, which explores...

15 Huhti 201932min

Mapping Dark Matter with Bayesian Neural Networks w/ Yashar Hezaveh - TWiML Talk #250

Mapping Dark Matter with Bayesian Neural Networks w/ Yashar Hezaveh - TWiML Talk #250

Today we’re joined by Yashar Hezaveh, Assistant Professor at the University of Montreal. Yashar and I caught up to discuss his work on gravitational lensing, which is the bending of light from distant...

11 Huhti 201934min

Deep Learning for Population Genetic Inference with Dan Schrider - TWiML Talk #249

Deep Learning for Population Genetic Inference with Dan Schrider - TWiML Talk #249

Today we’re joined by Dan Schrider, assistant professor in the department of genetics at UNC Chapel Hill. My discussion with Dan starts with an overview of population genomics, looking into his appl...

9 Huhti 201949min

Empathy in AI with Rob Walker - TWiML Talk #248

Empathy in AI with Rob Walker - TWiML Talk #248

Today we’re joined by Rob Walker, Vice President of Decision Management at Pegasystems. Rob joined us back in episode 127 to discuss “Hyperpersonalizing the customer experience.” Today, he’s back fo...

5 Huhti 201940min

Benchmarking Custom Computer Vision Services at Urban Outfitters with Tom Szumowski - TWiML Talk #247

Benchmarking Custom Computer Vision Services at Urban Outfitters with Tom Szumowski - TWiML Talk #247

Today we’re joined by Tom Szumowski, Data Scientist at URBN, parent company of Urban Outfitters and other consumer fashion brands. Tom and I caught up to discuss his project “Exploring Custom Vision S...

3 Huhti 201950min

Suosittua kategoriassa Politiikka ja uutiset

uutiscast
aikalisa
rss-ootsa-kuullut-tasta
politiikan-puskaradio
ootsa-kuullut-tasta-2
tervo-halme
viisupodi
rss-vaalirankkurit-podcast
rss-podme-livebox
rss-asiastudio
rikosmyytit
the-ulkopolitist
et-sa-noin-voi-sanoo-esittaa
otetaan-yhdet
io-techin-tekniikkapodcast
linda-maria
radio-antro
rss-sanna-ukkola-show-verkkouutiset
aihe
rss-tasta-on-kyse-ivan-puopolo-verkkouutiset