An Agentic Mixture of Experts for DevOps with Sunil Mallya - #708

An Agentic Mixture of Experts for DevOps with Sunil Mallya - #708

Today we're joined by Sunil Mallya, CTO and co-founder of Flip AI. We discuss Flip’s incident debugging system for DevOps, which was built using a custom mixture of experts (MoE) large language model (LLM) trained on a novel "CoMELT" observability dataset which combines traditional MELT data—metrics, events, logs, and traces—with code to efficiently identify root failure causes in complex software systems. We discuss the challenges of integrating time-series data with LLMs and their multi-decoder architecture designed for this purpose. Sunil describes their system's agent-based design, focusing on clear roles and boundaries to ensure reliability. We examine their "chaos gym," a reinforcement learning environment used for testing and improving the system's robustness. Finally, we discuss the practical considerations of deploying such a system at scale in diverse environments and much more. The complete show notes for this episode can be found at https://twimlai.com/go/708.

Avsnitt(781)

Exploring the FastAI Tooling Ecosystem with Hamel Husain - #532

Exploring the FastAI Tooling Ecosystem with Hamel Husain - #532

Today we’re joined by Hamel Husain, Staff Machine Learning Engineer at GitHub.  Over the last few years, Hamel has had the opportunity to work on some of the most popular open source projects in the M...

1 Nov 202139min

Multi-task Learning for Melanoma Detection with Julianna Ianni - #531

Multi-task Learning for Melanoma Detection with Julianna Ianni - #531

In today’s episode, we are joined by Julianna Ianni, vice president of AI research & development at Proscia. In our conversation, Julianna shares her and her team’s research focused on developing app...

28 Okt 202137min

House Hunters: Machine Learning at Redfin with Akshat Kaul - #530

House Hunters: Machine Learning at Redfin with Akshat Kaul - #530

Today we’re joined by Akshat Kaul, the head of data science and machine learning at Redfin. We’re all familiar with Redfin, but did you know that redfin.com is the largest real estate brokerage site i...

26 Okt 202144min

Attacking Malware with Adversarial Machine Learning, w/ Edward Raff - #529

Attacking Malware with Adversarial Machine Learning, w/ Edward Raff - #529

Today we’re joined by Edward Raff, chief scientist and head of the machine learning research group at Booz Allen Hamilton. Edward’s work sits at the intersection of machine learning and cybersecurity,...

21 Okt 202146min

Learning to Ponder: Memory in Deep Neural Networks with Andrea Banino - #528

Learning to Ponder: Memory in Deep Neural Networks with Andrea Banino - #528

Today we’re joined by Andrea Banino, a research scientist at DeepMind. In our conversation with Andrea, we explore his interest in artificial general intelligence by way of episodic memory, the relati...

18 Okt 202137min

Advancing Deep Reinforcement Learning with NetHack, w/ Tim Rocktäschel - #527

Advancing Deep Reinforcement Learning with NetHack, w/ Tim Rocktäschel - #527

Take our survey at twimlai.com/survey21! Today we’re joined by Tim Rocktäschel, a research scientist at Facebook AI Research and an associate professor at University College London (UCL).  Tim’s wor...

14 Okt 202142min

Building Technical Communities at Stack Overflow with Prashanth Chandrasekar - #526

Building Technical Communities at Stack Overflow with Prashanth Chandrasekar - #526

In this special episode of the show, we’re excited to bring you our conversation with Prashanth Chandrasekar, CEO of Stack Overflow. This interview was recorded as a part of the annual Prosus AI Marke...

11 Okt 202140min

Deep Learning is Eating 5G. Here’s How, w/ Joseph Soriaga - #525

Deep Learning is Eating 5G. Here’s How, w/ Joseph Soriaga - #525

Today we’re joined by Joseph Soriaga, a senior director of technology at Qualcomm.  In our conversation with Joseph, we focus on a pair of papers that he and his team will be presenting at Globecom l...

7 Okt 202139min

Populärt inom Politik & nyheter

svenska-fall
aftonbladet-krim
p3-krim
fordomspodden
rss-krimstad
motiv
flashback-forever
aftonbladet-daily
blenda-2
rss-sanning-konsekvens
rss-krimreportrarna
rss-vad-fan-hande
olyckan-inifran
svd-ledarredaktionen
rss-frandfors-horna
spar
rss-flodet
dagens-eko
krimmagasinet
politiken