An Agentic Mixture of Experts for DevOps with Sunil Mallya - #708

An Agentic Mixture of Experts for DevOps with Sunil Mallya - #708

Today we're joined by Sunil Mallya, CTO and co-founder of Flip AI. We discuss Flip’s incident debugging system for DevOps, which was built using a custom mixture of experts (MoE) large language model (LLM) trained on a novel "CoMELT" observability dataset which combines traditional MELT data—metrics, events, logs, and traces—with code to efficiently identify root failure causes in complex software systems. We discuss the challenges of integrating time-series data with LLMs and their multi-decoder architecture designed for this purpose. Sunil describes their system's agent-based design, focusing on clear roles and boundaries to ensure reliability. We examine their "chaos gym," a reinforcement learning environment used for testing and improving the system's robustness. Finally, we discuss the practical considerations of deploying such a system at scale in diverse environments and much more. The complete show notes for this episode can be found at https://twimlai.com/go/708.

Jaksot(781)

An Optimized Recurrent Unit for Ultra-Low Power Acoustic Event Detection with Justice Amoh Jr. - TWiML Talk #230

An Optimized Recurrent Unit for Ultra-Low Power Acoustic Event Detection with Justice Amoh Jr. - TWiML Talk #230

Today, we're joined by Justice Amoh Jr., a Ph.D. student at Dartmouth’s Thayer School of Engineering. Justice presented his work on “An Optimized Recurrent Unit for Ultra-Low Power Acoustic Event Det...

11 Helmi 201945min

Pathologies of Neural Models and Interpretability with Alvin Grissom II - TWiML Talk #229

Pathologies of Neural Models and Interpretability with Alvin Grissom II - TWiML Talk #229

Today, we continue our Black in AI series with Alvin Grissom II, Assistant Professor of Computer Science at Ursinus College. In our conversation, we dive into the paper he presented at the workshop, “...

11 Helmi 201932min

AI for Earth with Lucas Joppa - TWiML Talk #228

AI for Earth with Lucas Joppa - TWiML Talk #228

Today we’re joined by Lucas Joppa, Chief Environmental Officer at Microsoft and Zach Parisa, Co-founder and president of Silvia Terra, a Microsoft AI for Earth grantee. In our conversation, we explor...

8 Helmi 201956min

AI for Accessibility with Wendy Chisholm - TWiML Talk #227

AI for Accessibility with Wendy Chisholm - TWiML Talk #227

Today we’re joined by Wendy Chisholm, a principal accessibility architect at Microsoft, and one of the chief proponents of the AI for Accessibility program, which extends grants to AI-powered accessib...

6 Helmi 201950min

AI for Humanitarian Action with Justin Spelhaug - TWiML Talk #226

AI for Humanitarian Action with Justin Spelhaug - TWiML Talk #226

Today we're joined by Justin Spelhaug, General Manager of Technology for Social Impact at Microsoft. In our conversation, we discuss the company’s efforts in AI for Humanitarian Action, covering Mic...

4 Helmi 201958min

Teaching AI to Preschoolers with Randi Williams - TWiML Talk #225

Teaching AI to Preschoolers with Randi Williams - TWiML Talk #225

Today, in the first episode of our Black in AI series, we’re joined by Randi Williams, PhD student at the MIT Media Lab. At the Black in AI workshop Randi presented her research on Popbots: A Early C...

31 Tammi 201943min

Holistic Optimization of the LinkedIn News Feed - TWiML Talk #224

Holistic Optimization of the LinkedIn News Feed - TWiML Talk #224

Today we’re joined by Tim Jurka, Head of Feed AI at LinkedIn. In our conversation, Tim describes the holistic optimization of the feed and we discuss some of the interesting technical and business cha...

28 Tammi 201948min

AI at the Edge at Qualcomm with Gary Brotman - TWiML Talk #223

AI at the Edge at Qualcomm with Gary Brotman - TWiML Talk #223

Today we’re joined by Gary Brotman, Senior Director of Product Management at Qualcomm Technologies, Inc. Gary, who got his start in AI through music, now leads strategy and product planning for the c...

24 Tammi 201951min

Suosittua kategoriassa Politiikka ja uutiset

uutiscast
aikalisa
rss-ootsa-kuullut-tasta
politiikan-puskaradio
ootsa-kuullut-tasta-2
tervo-halme
viisupodi
rss-podme-livebox
rss-asiastudio
rikosmyytit
the-ulkopolitist
et-sa-noin-voi-sanoo-esittaa
otetaan-yhdet
radio-antro
rss-sanna-ukkola-show-verkkouutiset
io-techin-tekniikkapodcast
aihe
rss-tasta-on-kyse-ivan-puopolo-verkkouutiset
rss-kyselytunti
rss-tekkipodi