Measuring LLMs with Jodie Burchell
.NET Rocks!3 Huhti 2025

Measuring LLMs with Jodie Burchell

How do you measure the quality of a large language model? Carl and Richard talk to Dr. Jodie Burchell about her work measuring large language models for accuracy, reliability, and consistency. Jodie talks about the variety of benchmarks that exist for LLMs and the problems they have. A broader conversation about quality digs into the idea that LLMs should be targeted to the particular topic area they are being used for - often, smaller is better! Building a good test suite for your LLM is challenging but can increase your confidence that the tool will work as expected.

Jaksot(1988)

SQL Server DevOps with Kevin Cunnane and Eric Kang

SQL Server DevOps with Kevin Cunnane and Eric Kang

DevOps with SQL Server? Yes! While at Ignite in Orlando, Carl and Richard sat down with Kevin Cunnane and Eric Kang to talk about the latest set of tooling in SQL Server to facilitate incorporating SQ...

2 Marras 201758min

AI for Developers with David Carmona

AI for Developers with David Carmona

What can developers do with artificial intelligence? While at Ignite in Orlando, Carl and Richard sat down with David Carmona to talk about the latest AI offerings from Microsoft. The conversation sta...

31 Loka 201753min

Building Web Apps using vue.js with Shawn Wildermuth

Building Web Apps using vue.js with Shawn Wildermuth

Ready for a different vue on web pages? Carl and Richard talk to Shawn Wildermuth about his experiences with vueJS. The conversation starts out with a discussion about the endless range of JavaScript ...

26 Loka 201756min

Git Source Control for Everyone with Dmitry Lyalin and Ed Thomson

Git Source Control for Everyone with Dmitry Lyalin and Ed Thomson

Git for everyone! While at Ignite in Orlando, Carl and Richard talked to Ed Thomson and Dmitry Lyalin about the latest updates to Visual Studio Team Services that includes deep integration with Git - ...

24 Loka 201748min

SpaceX BFR 2.0 Geek Out

SpaceX BFR 2.0 Geek Out

In September 2017, Elon Musk walked out on stage at the International Astronautical Congress and updated everyone on SpaceX's latest plans. Time for a Geek Out! But first, an update on all of SpaceX's...

19 Loka 20171h 14min

.NET Core, Standard and the Future with Scott Hunter

.NET Core, Standard and the Future with Scott Hunter

.NET Core 2 is shipped - what comes next? While at Ignite in Orlando, Carl and Richard chatted with Scott Hunter about life after shipping .NET Core 2. The conversation ranges over what the .NET Stand...

17 Loka 201742min

Many Kinds of Messaging with Clemens Vasters

Many Kinds of Messaging with Clemens Vasters

There are so many messaging options in Azure, how do you choose? While at ProgNet in London, Carl and Richard sat down with Clemens Vasters to talk through the strengths and weaknesses of each messagi...

12 Loka 201755min

AI Panel from DevIntersection Europe!

AI Panel from DevIntersection Europe!

What's up with Artificial Intelligence - and why should we care? While at DevIntersection in Stockholm, Carl and Richard hosted a panel discussion with Seth Juarez, Jessica Engstrom and Tess Ferrandez...

10 Loka 201754min