Production LLMs with Vaishnavi Gudur

Production LLMs with Vaishnavi Gudur

What does a production-grade large language model look like? While at NDC Sydney, Richard talked with Vaishnavi Gudur from Microsoft about her work scaling LLMs for Teams transcriptions, summaries, and more! Vaishnavi discusses the underlying complexities of operating the Teams LLM infrastructure for a large array of customers across different countries and regulatory regimes. Data sovereignty also plays a large role: different countries have specific rules on where data must reside and how it can be accessed. As the scale increases and the tail gets longer, the rules set gets more complex! Lots of great thinking about what LLMs look like in a production environment.

Links

Recorded April 24, 2026

Denne episoden er hentet fra en åpen RSS-feed og er ikke publisert av Podme. Den kan derfor inneholde annonser.

Episoder(1050)

Automatic Attack Disruption with Liz Tesch

Automatic Attack Disruption with Liz Tesch

What if Microsoft Defender not only detected attackers - but also fought back? Richard talks to Liz Tesch about Microsoft Defender Automatic Attack Disruption and Predictive Shielding. Liz talks about...

19 Aug 38min

The Content Management System Landscape with Matt Garrepy

The Content Management System Landscape with Matt Garrepy

What is the state of content management systems today? Richard chats with Matthew Garrepy of CMS Critic about his views on how the CMS market continues to evolve. Matt digs into the build-vs-buy conve...

12 Aug 40min

Ransomware Readiness with Heather Renze

Ransomware Readiness with Heather Renze

The risk of ransomware is real - are you ready? Richard talks with Heather Renze about her experiences dealing with a ransomware attack and how to get prepared when it happens to you. Heather talks ab...

5 Aug 37min

Azure Virtual Desktop Hybrid with Travis Roberts

Azure Virtual Desktop Hybrid with Travis Roberts

More ways to use Azure Virtual Desktop! Richard chats with Travis Roberts about how Azure Virtual Desktop continues to evolve and provides more options for remote users. Travis talks about how AVD gre...

29 Jul 34min

Security Begins at Procurement with Jessie Schofer

Security Begins at Procurement with Jessie Schofer

Bringing new software or SaaS into your organization is a security risk - how do you assess it? Richard chats with Jessie Schofer about her experiences in HR software acquisition, which led to the cre...

22 Jul 37min

Finding Security Vulnerabilities using AI with Sami Laiho

Finding Security Vulnerabilities using AI with Sami Laiho

How are large language models changing the way security vulnerabilities are found? Richard chats with Sami Laiho about the rapidly changing landscape in security exploits. Certain LLM models like Anth...

15 Jul 38min

Implementing Azure Policies with Barbara Forbes

Implementing Azure Policies with Barbara Forbes

How can Azure Policies help you? While at Techorama in Belgium, Richard sat down with Barbara Forbes to discuss how Azure Policies have evolved and the techniques sysadmins are using to improve securi...

8 Jul 35min

AI-Accelerated Supply Chain Attacks with Mackenzie Jackson

AI-Accelerated Supply Chain Attacks with Mackenzie Jackson

How are supply-chain attacks evolving? Richard chats with Mackenzie Jackson about his work helping companies protect their software supply chains from malware attacks. Mackenzie discusses the vulnerab...

1 Jul 36min

Populært innen Business og økonomi

stopp-verden
lydartikler-fra-aftenposten
dine-penger-pengeradet
rss-penger-polser-og-politikk
rss-borsmorgen-okonominyhetene
rss-skravla-gar
e24-podden
lederpodden
rss-pa-konto
utbytte
pengepodden-2
livet-pa-veien-med-jan-erik-larssen
finansredaksjonen
morgenkaffen-med-finansavisen
rss-orjasater
tid-er-penger-en-podcast-med-peter-warren
liberal-halvtime
pengesnakk
rss-markedspuls-2
okonomiamatorene