An Agentic Mixture of Experts for DevOps with Sunil Mallya - #708

An Agentic Mixture of Experts for DevOps with Sunil Mallya - #708

Today we're joined by Sunil Mallya, CTO and co-founder of Flip AI. We discuss Flip’s incident debugging system for DevOps, which was built using a custom mixture of experts (MoE) large language model (LLM) trained on a novel "CoMELT" observability dataset which combines traditional MELT data—metrics, events, logs, and traces—with code to efficiently identify root failure causes in complex software systems. We discuss the challenges of integrating time-series data with LLMs and their multi-decoder architecture designed for this purpose. Sunil describes their system's agent-based design, focusing on clear roles and boundaries to ensure reliability. We examine their "chaos gym," a reinforcement learning environment used for testing and improving the system's robustness. Finally, we discuss the practical considerations of deploying such a system at scale in diverse environments and much more. The complete show notes for this episode can be found at https://twimlai.com/go/708.

Avsnitt(781)

Exploring AI 2041 with Kai-Fu Lee - #516

Exploring AI 2041 with Kai-Fu Lee - #516

Today we’re joined by Kai-Fu Lee, chairman and CEO of Sinovation Ventures and author of AI 2041: Ten Visions for Our Future.  In AI 2041, Kai-Fu and co-author Chen Qiufan tell the story of how AI cou...

6 Sep 202147min

Advancing Robotic Brains and Bodies with Daniela Rus - #515

Advancing Robotic Brains and Bodies with Daniela Rus - #515

Today we’re joined by Daniela Rus, director of CSAIL & Deputy Dean of Research at MIT.  In our conversation with Daniela, we explore the history of CSAIL, her role as director of one of the most pres...

2 Sep 202145min

Neural Synthesis of Binaural Speech From Mono Audio with Alexander Richard - #514

Neural Synthesis of Binaural Speech From Mono Audio with Alexander Richard - #514

Today we’re joined by Alexander Richard, a research scientist at Facebook Reality Labs, and recipient of the ICLR Best Paper Award for his paper “Neural Synthesis of Binaural Speech From Mono Audio.” ...

30 Aug 202146min

Using Brain Imaging to Improve Neural Networks with Alona Fyshe - #513

Using Brain Imaging to Improve Neural Networks with Alona Fyshe - #513

Today we’re joined by Alona Fyshe, an assistant professor at the University of Alberta.  We caught up with Alona on the heels of an interesting panel discussion that she participated in, centered aro...

26 Aug 202136min

Adaptivity in Machine Learning with Samory Kpotufe - #512

Adaptivity in Machine Learning with Samory Kpotufe - #512

Today we’re joined by Samory Kpotufe, an associate professor at Columbia University and program chair of the 2021 Conference on Learning Theory (COLT).  In our conversation with Samory, we explore hi...

23 Aug 202149min

A Social Scientist’s Perspective on AI with Eric Rice - #511

A Social Scientist’s Perspective on AI with Eric Rice - #511

Today we’re joined by Eric Rice, associate professor at USC, and the co-director of the USC Center for Artificial Intelligence in Society.  Eric is a sociologist by trade, and in our conversation, we...

19 Aug 202143min

Applications of Variational Autoencoders and Bayesian Optimization with José Miguel Hernández Lobato - #510

Applications of Variational Autoencoders and Bayesian Optimization with José Miguel Hernández Lobato - #510

Today we’re joined by José Miguel Hernández-Lobato, a university lecturer in machine learning at the University of Cambridge. In our conversation with Miguel, we explore his work at the intersection o...

16 Aug 202142min

Codex, OpenAI’s Automated Code Generation API with Greg Brockman - #509

Codex, OpenAI’s Automated Code Generation API with Greg Brockman - #509

Today we’re joined by return guest Greg Brockman, co-founder and CTO of OpenAI. We had the pleasure of reconnecting with Greg on the heels of the announcement of Codex, OpenAI’s most recent release. C...

12 Aug 202147min

Populärt inom Politik & nyheter

svenska-fall
aftonbladet-krim
p3-krim
fordomspodden
rss-krimstad
motiv
flashback-forever
aftonbladet-daily
blenda-2
rss-sanning-konsekvens
rss-krimreportrarna
rss-vad-fan-hande
olyckan-inifran
svd-ledarredaktionen
rss-frandfors-horna
spar
rss-flodet
dagens-eko
krimmagasinet
politiken