An Agentic Mixture of Experts for DevOps with Sunil Mallya - #708

An Agentic Mixture of Experts for DevOps with Sunil Mallya - #708

Today we're joined by Sunil Mallya, CTO and co-founder of Flip AI. We discuss Flip’s incident debugging system for DevOps, which was built using a custom mixture of experts (MoE) large language model (LLM) trained on a novel "CoMELT" observability dataset which combines traditional MELT data—metrics, events, logs, and traces—with code to efficiently identify root failure causes in complex software systems. We discuss the challenges of integrating time-series data with LLMs and their multi-decoder architecture designed for this purpose. Sunil describes their system's agent-based design, focusing on clear roles and boundaries to ensure reliability. We examine their "chaos gym," a reinforcement learning environment used for testing and improving the system's robustness. Finally, we discuss the practical considerations of deploying such a system at scale in diverse environments and much more. The complete show notes for this episode can be found at https://twimlai.com/go/708.

Avsnitt(780)

AI-Powered Peer Programming with Vasi Philomin - #594

AI-Powered Peer Programming with Vasi Philomin - #594

Today we’re joined by Vasi Philomin, vice president of AI services at AWS, joins us for our first in-person interview since 2019! In our conversation with Vasi, we discussed the recently released Amaz...

10 Okt 202235min

The Top 10 Reasons to Register for TWIMLcon: AI Platforms 2022!

The Top 10 Reasons to Register for TWIMLcon: AI Platforms 2022!

TWIMLcon: AI Platforms 2022 is just a day away! If you're interested in all things MLOps and Platforms/Infrastructure technology, this is the event for you! Register now at https://twimlcon.com/attend...

3 Okt 20224min

Applied AI/ML Research at PayPal with Vidyut Naware - #593

Applied AI/ML Research at PayPal with Vidyut Naware - #593

Today we’re joined by Vidyut Naware, the director of machine learning and artificial intelligence at Paypal. As the leader of the ML/AI organization at Paypal, Vidyut is responsible for all things app...

26 Sep 202231min

Assessing Data Quality at Shopify with Wendy Foster - #592

Assessing Data Quality at Shopify with Wendy Foster - #592

Today we’re back with another installment of our Data-Centric AI series, joined by Wendy Foster, a director of engineering & data science at Shopify. In our conversation with Wendy, we explore the dif...

19 Sep 202236min

Transformers for Tabular Data at Capital One with Bayan Bruss - #591

Transformers for Tabular Data at Capital One with Bayan Bruss - #591

Today we’re joined by Bayan Bruss, a Sr. director of applied ML research at Capital One. In our conversation with Bayan, we dig into his work in applying various deep learning techniques to tabular da...

12 Sep 202246min

Understanding Collective Insect Communication with ML, w/ Orit Peleg - #590

Understanding Collective Insect Communication with ML, w/ Orit Peleg - #590

Today we’re joined by Orit Peleg, an assistant professor at the University of Colorado, Boulder. Orit’s work focuses on understanding the behavior of disordered living systems, by merging tools from p...

5 Sep 202237min

Multimodal, Multi-Lingual NLP at Hugging Face with John Bohannon and Douwe Kiela - #589

Multimodal, Multi-Lingual NLP at Hugging Face with John Bohannon and Douwe Kiela - #589

In this extra special episode of the TWIML AI Podcast, a friend of the show John Bohannon leads a jam-packed conversation with Hugging Face’s recently appointed head of research Douwe Kiela. In our co...

29 Aug 202253min

Synthetic Data Generation for Robotics with Bill Vass - #588

Synthetic Data Generation for Robotics with Bill Vass - #588

Today we’re joined by Bill Vass, a VP of engineering at Amazon Web Services. Bill spoke at the most recent AWS re:MARS conference, where he delivered an engineering Keynote focused on some recent upda...

22 Aug 202236min

Populärt inom Politik & nyheter

aftonbladet-krim
svenska-fall
rss-krimstad
p3-krim
fordomspodden
flashback-forever
motiv
blenda-2
rss-sanning-konsekvens
aftonbladet-daily
rss-krimreportrarna
svd-ledarredaktionen
rss-vad-fan-hande
olyckan-inifran
rss-frandfors-horna
spar
rss-flodet
politiken
dagens-eko
krimmagasinet