An Agentic Mixture of Experts for DevOps with Sunil Mallya - #708

An Agentic Mixture of Experts for DevOps with Sunil Mallya - #708

Today we're joined by Sunil Mallya, CTO and co-founder of Flip AI. We discuss Flip’s incident debugging system for DevOps, which was built using a custom mixture of experts (MoE) large language model (LLM) trained on a novel "CoMELT" observability dataset which combines traditional MELT data—metrics, events, logs, and traces—with code to efficiently identify root failure causes in complex software systems. We discuss the challenges of integrating time-series data with LLMs and their multi-decoder architecture designed for this purpose. Sunil describes their system's agent-based design, focusing on clear roles and boundaries to ensure reliability. We examine their "chaos gym," a reinforcement learning environment used for testing and improving the system's robustness. Finally, we discuss the practical considerations of deploying such a system at scale in diverse environments and much more. The complete show notes for this episode can be found at https://twimlai.com/go/708.

Avsnitt(781)

Building, Adopting, and Maturing LinkedIn's Machine Learning Platform with Ya Xu - #453

Building, Adopting, and Maturing LinkedIn's Machine Learning Platform with Ya Xu - #453

Today we’re joined by Ya Xu, head of Data Science at LinkedIn, and TWIMLcon: AI Platforms 2021 Keynote Speaker. We cover a ton of ground with Ya, starting with her experiences prior to becoming Head ...

4 Feb 202149min

Expressive Deep Learning with Magenta DDSP w/ Jesse Engel - #452

Expressive Deep Learning with Magenta DDSP w/ Jesse Engel - #452

Today we’re joined by Jesse Engel, Staff Research Scientist at Google, working on the Magenta Project.  In our conversation with Jesse, we explore the current landscape of creativity AI, and the role...

1 Feb 202139min

Semantic Folding for Natural Language Understanding with Francisco Weber - #451

Semantic Folding for Natural Language Understanding with Francisco Weber - #451

Today we’re joined by return guest Francisco Webber, CEO & Co-founder of Cortical.io. Francisco was originally a guest over 4 years and 400 episodes ago, where we discussed his company Cortical.io, a...

29 Jan 202155min

The Future of Autonomous Systems with Gurdeep Pall - #450

The Future of Autonomous Systems with Gurdeep Pall - #450

Today we’re joined by Gurdeep Pall, Corporate Vice President at Microsoft. Gurdeep, who we had the pleasure of speaking with on his 31st anniversary at the company, has had a hand in creating quite a...

25 Jan 202153min

AI for Ecology and Ecosystem Preservation with Bryan Carstens - #449

AI for Ecology and Ecosystem Preservation with Bryan Carstens - #449

Today we’re joined by Bryan Carstens, a professor in the Department of Evolution, Ecology, and Organismal Biology & Head of the Tetrapod Division in the Museum of Biological Diversity at The Ohio Stat...

21 Jan 202135min

Off-Line, Off-Policy RL for Real-World Decision Making at Facebook - #448

Off-Line, Off-Policy RL for Real-World Decision Making at Facebook - #448

Today we’re joined by Jason Gauci, a Software Engineering Manager at Facebook AI. In our conversation with Jason, we explore their Reinforcement Learning platform, Re-Agent (Horizon). We discuss the ...

18 Jan 20211h 1min

A Future of Work for the Invisible Workers in A.I. with Saiph Savage - #447

A Future of Work for the Invisible Workers in A.I. with Saiph Savage - #447

Today we’re joined by Saiph Savage, a Visiting professor at the Human-Computer Interaction Institute at CMU, director of the HCI Lab at WVU, and co-director of the Civic Innovation Lab at UNAM. We ca...

14 Jan 202138min

Trends in Graph Machine Learning with Michael Bronstein - #446

Trends in Graph Machine Learning with Michael Bronstein - #446

Today we’re back with the final episode of AI Rewind joined by Michael Bronstein, a professor at Imperial College London and the Head of Graph Machine Learning at Twitter. In our conversation with Mi...

11 Jan 20211h 14min

Populärt inom Politik & nyheter

svenska-fall
aftonbladet-krim
p3-krim
rss-krimstad
fordomspodden
flashback-forever
motiv
rss-sanning-konsekvens
aftonbladet-daily
blenda-2
spar
rss-krimreportrarna
svd-ledarredaktionen
olyckan-inifran
rss-frandfors-horna
rss-vad-fan-hande
rss-flodet
dagens-eko
krimmagasinet
politiken