An Agentic Mixture of Experts for DevOps with Sunil Mallya - #708

An Agentic Mixture of Experts for DevOps with Sunil Mallya - #708

Today we're joined by Sunil Mallya, CTO and co-founder of Flip AI. We discuss Flip’s incident debugging system for DevOps, which was built using a custom mixture of experts (MoE) large language model (LLM) trained on a novel "CoMELT" observability dataset which combines traditional MELT data—metrics, events, logs, and traces—with code to efficiently identify root failure causes in complex software systems. We discuss the challenges of integrating time-series data with LLMs and their multi-decoder architecture designed for this purpose. Sunil describes their system's agent-based design, focusing on clear roles and boundaries to ensure reliability. We examine their "chaos gym," a reinforcement learning environment used for testing and improving the system's robustness. Finally, we discuss the practical considerations of deploying such a system at scale in diverse environments and much more. The complete show notes for this episode can be found at https://twimlai.com/go/708.

Avsnitt(781)

Trends in Machine Learning & Deep Learning with Zachary Lipton - #556

Trends in Machine Learning & Deep Learning with Zachary Lipton - #556

Today we continue our AI Rewind 2021 series joined by a friend of the show, assistant professor at Carnegie Mellon University, and AI Rewind veteran, Zack Lipton! In our conversation with Zack, we tou...

27 Jan 20221h 8min

Solving the Cocktail Party Problem with Machine Learning, w/ ‪Jonathan Le Roux - #555

Solving the Cocktail Party Problem with Machine Learning, w/ ‪Jonathan Le Roux - #555

Today we’re joined by Jonathan Le Roux, a senior principal research scientist at Mitsubishi Electric Research Laboratories (MERL). At MERL, Jonathan and his team are focused on using machine learning ...

24 Jan 202235min

Machine Learning for Earthquake Seismology with Karianne Bergen - #554

Machine Learning for Earthquake Seismology with Karianne Bergen - #554

Today we’re joined by Karianne Bergen, an assistant professor at Brown University. In our conversation with Karianne, we explore her work at the intersection of earthquake seismology and machine learn...

20 Jan 202235min

The New DBfication of ML/AI with Arun Kumar - #553

The New DBfication of ML/AI with Arun Kumar - #553

Today we’re joined by Arun Kumarm, an associate professor at UC San Diego. We had the pleasure of catching up with Arun prior to the Workshop on Databases and AI at NeurIPS 2021, where he delivered th...

17 Jan 202246min

Building Public Interest Technology with Meredith Broussard - #552

Building Public Interest Technology with Meredith Broussard - #552

Today we’re joined by Meredith Broussard, an associate professor at NYU & research director at the NYU Alliance for Public Interest Technology. Meredith was a keynote speaker at the recent NeurIPS con...

13 Jan 202230min

A Universal Law of Robustness via Isoperimetry with Sebastien Bubeck - #551

A Universal Law of Robustness via Isoperimetry with Sebastien Bubeck - #551

Today we’re joined by Sebastian Bubeck a sr principal research manager at Microsoft, and author of the paper A Universal Law of Robustness via Isoperimetry, a NeurIPS 2021 Outstanding Paper Award reci...

10 Jan 202239min

Trends in NLP with John Bohannon - #550

Trends in NLP with John Bohannon - #550

Today we’re joined by friend of the show John Bohannon, the director of science at Primer AI, to help us showcase all of the great achievements and accomplishments in NLP in 2021! In our conversation,...

6 Jan 20221h 18min

Trends in Computer Vision with Georgia Gkioxari - #549

Trends in Computer Vision with Georgia Gkioxari - #549

Happy New Year! We’re excited to kick off 2022 joined by Georgia Gkioxari, a research scientist at Meta AI, to showcase the best advances in the field of computer vision over the past 12 months, and w...

3 Jan 202258min

Populärt inom Politik & nyheter

svenska-fall
aftonbladet-krim
p3-krim
fordomspodden
rss-krimstad
motiv
flashback-forever
aftonbladet-daily
blenda-2
rss-sanning-konsekvens
rss-krimreportrarna
rss-vad-fan-hande
olyckan-inifran
svd-ledarredaktionen
rss-frandfors-horna
spar
rss-flodet
dagens-eko
krimmagasinet
politiken