An Agentic Mixture of Experts for DevOps with Sunil Mallya - #708

An Agentic Mixture of Experts for DevOps with Sunil Mallya - #708

Today we're joined by Sunil Mallya, CTO and co-founder of Flip AI. We discuss Flip’s incident debugging system for DevOps, which was built using a custom mixture of experts (MoE) large language model (LLM) trained on a novel "CoMELT" observability dataset which combines traditional MELT data—metrics, events, logs, and traces—with code to efficiently identify root failure causes in complex software systems. We discuss the challenges of integrating time-series data with LLMs and their multi-decoder architecture designed for this purpose. Sunil describes their system's agent-based design, focusing on clear roles and boundaries to ensure reliability. We examine their "chaos gym," a reinforcement learning environment used for testing and improving the system's robustness. Finally, we discuss the practical considerations of deploying such a system at scale in diverse environments and much more. The complete show notes for this episode can be found at https://twimlai.com/go/708.

Jaksot(781)

Practical Natural Language Processing with spaCy and Prodigy w/ Ines Montani - TWiML Talk #262

Practical Natural Language Processing with spaCy and Prodigy w/ Ines Montani - TWiML Talk #262

In this episode of PyDataSci, we’re joined by Ines Montani, Cofounder of Explosion, Co-developer of SpaCy and lead developer of Prodigy. Ines and I caught up to discuss her various projects, includin...

7 Touko 201948min

Scaling Jupyter Notebooks with Luciano Resende - TWiML Talk #261

Scaling Jupyter Notebooks with Luciano Resende - TWiML Talk #261

Today we're joined by Luciano Resende, an Open Source AI Platform Architect at IBM, to discuss his work on Jupyter Enterprise Gateway. In our conversation, we address challenges that arise while usin...

6 Touko 201933min

Fighting Fake News and Deep Fakes with Machine Learning w/ Delip Rao - TWiML Talk #260

Fighting Fake News and Deep Fakes with Machine Learning w/ Delip Rao - TWiML Talk #260

Today we’re joined by Delip Rao, vice president of research at the AI Foundation, co-author of the book Natural Language Processing with PyTorch, and creator of the Fake News Challenge. In our conver...

3 Touko 201958min

Maintaining Human Control of Artificial Intelligence with Joanna Bryson - TWiML Talk #259

Maintaining Human Control of Artificial Intelligence with Joanna Bryson - TWiML Talk #259

Today we’re joined by Joanna Bryson, Reader at the University of Bath. I was fortunate to catch up with Joanna at the conference, where she presented on “Maintaining Human Control of Artificial Intel...

1 Touko 201938min

Intelligent Infrastructure Management with Pankaj Goyal & Rochna Dhand - TWiML Talk #258

Intelligent Infrastructure Management with Pankaj Goyal & Rochna Dhand - TWiML Talk #258

Today we're joined by Pankaj Goyal and Rochna Dhand, to discuss HPE InfoSight. In our conversation, Pankaj gives a look into how HPE as a company views AI, from their customers to the future of AI a...

29 Huhti 201944min

Organizing for Successful Data Science at Stitch Fix with Eric Colson - TWiML Talk #257

Organizing for Successful Data Science at Stitch Fix with Eric Colson - TWiML Talk #257

Today we’re joined by Eric Colson, Chief Algorithms Officer at Stitch Fix, whose presentation at the Strata Data conference explored “How to make fewer bad decisions.” Our discussion focuses in on th...

26 Huhti 201952min

End-to-End Data Science to Drive Business Decisions at LinkedIn with Burcu Baran - TWiML Talk #256

End-to-End Data Science to Drive Business Decisions at LinkedIn with Burcu Baran - TWiML Talk #256

In this episode of our Strata Data conference series, we’re joined by Burcu Baran, Senior Data Scientist at LinkedIn. At Strata, Burcu, along with a few members of her team, delivered the presentatio...

24 Huhti 201948min

Learning with Limited Labeled Data with Shioulin Sam - TWiML Talk #255

Learning with Limited Labeled Data with Shioulin Sam - TWiML Talk #255

Today we’re joined by Shioulin Sam, Research Engineer with Cloudera Fast Forward Labs. Shioulin and I caught up to discuss the newest report to come out of CFFL, “Learning with Limited Label Data,” ...

22 Huhti 201944min

Suosittua kategoriassa Politiikka ja uutiset

uutiscast
aikalisa
rss-ootsa-kuullut-tasta
politiikan-puskaradio
ootsa-kuullut-tasta-2
tervo-halme
viisupodi
rss-vaalirankkurit-podcast
rss-podme-livebox
rss-asiastudio
rikosmyytit
the-ulkopolitist
et-sa-noin-voi-sanoo-esittaa
otetaan-yhdet
io-techin-tekniikkapodcast
linda-maria
radio-antro
rss-sanna-ukkola-show-verkkouutiset
aihe
rss-tasta-on-kyse-ivan-puopolo-verkkouutiset