Production LLMs with Vaishnavi Gudur

Production LLMs with Vaishnavi Gudur

What does a production-grade large language model look like? While at NDC Sydney, Richard talked with Vaishnavi Gudur from Microsoft about her work scaling LLMs for Teams transcriptions, summaries, and more! Vaishnavi discusses the underlying complexities of operating the Teams LLM infrastructure for a large array of customers across different countries and regulatory regimes. Data sovereignty also plays a large role: different countries have specific rules on where data must reside and how it can be accessed. As the scale increases and the tail gets longer, the rules set gets more complex! Lots of great thinking about what LLMs look like in a production environment.

Links

Recorded April 24, 2026

Det här avsnittet är hämtat från ett öppet RSS-flöde och publiceras inte av Podme. Det kan innehålla reklam.

Avsnitt(1050)

Automatic Attack Disruption with Liz Tesch

Automatic Attack Disruption with Liz Tesch

What if Microsoft Defender not only detected attackers - but also fought back? Richard talks to Liz Tesch about Microsoft Defender Automatic Attack Disruption and Predictive Shielding. Liz talks about...

19 Aug 38min

The Content Management System Landscape with Matt Garrepy

The Content Management System Landscape with Matt Garrepy

What is the state of content management systems today? Richard chats with Matthew Garrepy of CMS Critic about his views on how the CMS market continues to evolve. Matt digs into the build-vs-buy conve...

12 Aug 40min

Ransomware Readiness with Heather Renze

Ransomware Readiness with Heather Renze

The risk of ransomware is real - are you ready? Richard talks with Heather Renze about her experiences dealing with a ransomware attack and how to get prepared when it happens to you. Heather talks ab...

5 Aug 37min

Azure Virtual Desktop Hybrid with Travis Roberts

Azure Virtual Desktop Hybrid with Travis Roberts

More ways to use Azure Virtual Desktop! Richard chats with Travis Roberts about how Azure Virtual Desktop continues to evolve and provides more options for remote users. Travis talks about how AVD gre...

29 Juli 34min

Security Begins at Procurement with Jessie Schofer

Security Begins at Procurement with Jessie Schofer

Bringing new software or SaaS into your organization is a security risk - how do you assess it? Richard chats with Jessie Schofer about her experiences in HR software acquisition, which led to the cre...

22 Juli 37min

Finding Security Vulnerabilities using AI with Sami Laiho

Finding Security Vulnerabilities using AI with Sami Laiho

How are large language models changing the way security vulnerabilities are found? Richard chats with Sami Laiho about the rapidly changing landscape in security exploits. Certain LLM models like Anth...

15 Juli 38min

Implementing Azure Policies with Barbara Forbes

Implementing Azure Policies with Barbara Forbes

How can Azure Policies help you? While at Techorama in Belgium, Richard sat down with Barbara Forbes to discuss how Azure Policies have evolved and the techniques sysadmins are using to improve securi...

8 Juli 35min

AI-Accelerated Supply Chain Attacks with Mackenzie Jackson

AI-Accelerated Supply Chain Attacks with Mackenzie Jackson

How are supply-chain attacks evolving? Richard chats with Mackenzie Jackson about his work helping companies protect their software supply chains from malware attacks. Mackenzie discusses the vulnerab...

1 Juli 36min

Populärt inom Business & ekonomi

framgangspodden
badfluence
dynastin
varvet
rss-borsens-finest
uppgang-och-fall
svd-tech-brief
rss-inga-dumma-fragor-om-pengar
avanzapodden
borsmorgon
rss-dagen-med-di
tabberaset
rss-kort-lang-analyspodden-fran-di
fill-or-kill
lastbilspodden
rss-hos-psykologen
market-makers
borslunch-2
ekonomiekot-extra
rss-veckans-trade