An Agentic Mixture of Experts for DevOps with Sunil Mallya - #708

An Agentic Mixture of Experts for DevOps with Sunil Mallya - #708

Today we're joined by Sunil Mallya, CTO and co-founder of Flip AI. We discuss Flip’s incident debugging system for DevOps, which was built using a custom mixture of experts (MoE) large language model (LLM) trained on a novel "CoMELT" observability dataset which combines traditional MELT data—metrics, events, logs, and traces—with code to efficiently identify root failure causes in complex software systems. We discuss the challenges of integrating time-series data with LLMs and their multi-decoder architecture designed for this purpose. Sunil describes their system's agent-based design, focusing on clear roles and boundaries to ensure reliability. We examine their "chaos gym," a reinforcement learning environment used for testing and improving the system's robustness. Finally, we discuss the practical considerations of deploying such a system at scale in diverse environments and much more. The complete show notes for this episode can be found at https://twimlai.com/go/708.

Episoder(781)

ML Platforms for Global Scale at Prosus with Paul van der Boor - #468 [TWIMLcon Sponsor Series]

ML Platforms for Global Scale at Prosus with Paul van der Boor - #468 [TWIMLcon Sponsor Series]

In this episode, we’re joined by Paul van der Boor, Senior Director of Data Science at Prosus, to discuss his TWIMLcon experience and how they’re using ML platforms to manage machine learning at a glo...

29 Mar 202122min

Can Language Models Be Too Big? 🦜 with Emily Bender and Margaret Mitchell - #467

Can Language Models Be Too Big? 🦜 with Emily Bender and Margaret Mitchell - #467

Today we’re joined by Emily M. Bender, Professor at the University of Washington, and AI Researcher, Margaret Mitchell.  Emily and Meg, as well as Timnit Gebru and Angelina McMillan-Major, are co-aut...

24 Mar 202154min

Applying RL to Real-World Robotics with Abhishek Gupta - #466

Applying RL to Real-World Robotics with Abhishek Gupta - #466

Today we’re joined by Abhishek Gupta, a PhD Student at UC Berkeley.  Abhishek, a member of the BAIR Lab, joined us to talk about his recent robotics and reinforcement learning research and interests,...

22 Mar 202136min

Accelerating Innovation with AI at Scale with David Carmona - #465

Accelerating Innovation with AI at Scale with David Carmona - #465

Today we’re joined by David Carmona, General Manager of Artificial Intelligence & Innovation at Microsoft.  In our conversation with David, we focus on his work on AI at Scale, an initiative focused ...

18 Mar 202148min

Complexity and Intelligence with Melanie Mitchell - #464

Complexity and Intelligence with Melanie Mitchell - #464

Today we’re joined by Melanie Mitchell, Davis Professor at the Santa Fe Institute and author of Artificial Intelligence: A Guide for Thinking Humans.  While Melanie has had a long career with a myria...

15 Mar 202132min

Robust Visual Reasoning with Adriana Kovashka - #463

Robust Visual Reasoning with Adriana Kovashka - #463

Today we’re joined by Adriana Kovashka, an Assistant Professor at the University of Pittsburgh. In our conversation with Adriana, we explore her visual commonsense research, and how it intersects wit...

11 Mar 202141min

Architectural and Organizational Patterns in Machine Learning with Nishan Subedi - #462

Architectural and Organizational Patterns in Machine Learning with Nishan Subedi - #462

Today we’re joined by Nishan Subedi, VP of Algorithms at Overstock.com. In our conversation with Nishan, we discuss his interesting path to MLOps and how ML/AI is used at Overstock, primarily for sea...

8 Mar 202157min

Common Sense Reasoning in NLP with Vered Shwartz - #461

Common Sense Reasoning in NLP with Vered Shwartz - #461

Today we’re joined by Vered Shwartz, a Postdoctoral Researcher at both the Allen Institute for AI and the Paul G. Allen School of Computer Science & Engineering at the University of Washington. In ou...

4 Mar 202137min

Populært innen Politikk og nyheter

giver-og-gjengen-vg
aftenpodden
stopp-verden
forklart
aftenpodden-usa
i-retten
lydartikler-fra-aftenposten
popradet
det-store-bildet
rss-gukild-johaug
dine-penger-pengeradet
rss-ness
fotballpodden-2
hanna-de-heldige
aftenbla-bla
nokon-ma-ga
grasoner-den-nye-kalde-krigen
frokostshowet-pa-p5
e24-podden
rss-penger-polser-og-politikk