Azure API Management's GenAI Gateway with Andrei Kamenev
.NET Rocks!7 Aug 2024

Azure API Management's GenAI Gateway with Andrei Kamenev

How do you manage APIs to GenAI, and how can GenAI help with API management? Carl and Richard chat with Andrei Kamenev about the latest features coming to Azure API Management. On the one hand, there are Copilot tools to help craft and understand APIM policies, which can get very complex. Then, there is the provisioning of access to GenAI-related APIs like the Azure OpenAI service, which utilize tokens - and those tokens mean money, so they need to be controlled. The GenAI Gateway provides the ability to rate-limit token issuing and all the other capabilities you expect from APIM. Prompt caching is in preview and can decrease the cost of repeated use of the same prompts. Many of the features are new, and more are coming!

Episoder(1988)

More Sustainable Software with Tom Kerkhove

More Sustainable Software with Tom Kerkhove

What does it take to make more environmentally sustainable software? Carl and Richard talk to Tom Herkhove about Microsoft's efforts to make carbon footprint and emissions visible for applications. To...

27 Nov 202553min

The Role of LLMs in Visual Studio Productivity with Leslie Richardson

The Role of LLMs in Visual Studio Productivity with Leslie Richardson

How are large language models going to change the way we use Visual Studio? Carl and Richard speak with Leslie Richardson about her work in Visual Studio, starting with the debugger and now focusing o...

20 Nov 20251h 1min

Old Developers using New Tools with Brady Gaster

Old Developers using New Tools with Brady Gaster

How are folks adapting to the new tools available for development today? Carl and Richard talk to Brady Gaster about his work on improving the tooling for software development at Microsoft - and the t...

13 Nov 20251h 1min

Cake.SDK with Mattias Karlsson

Cake.SDK with Mattias Karlsson

Ready to integrate build automation into your applications? Carl and Richard talk to Mattias Karlsson about the new Cake.SDK as an additional component of the Cake (C# Make) open source project. Matti...

6 Nov 202548min

GitHub Spec Kit with Den Delimarsky

GitHub Spec Kit with Den Delimarsky

How do you build quality software with LLMs? Carl and Richard talk to Den Delimarsky about the GitHub Spec Kit, which uses specifications to help LLMs generate code for you. Den discusses the iterativ...

30 Okt 20251h 4min

CSLA 9 with Rocky Lhotka

CSLA 9 with Rocky Lhotka

The next version of CSLA is out! Carl and Richard talk to Rocky Lhotka about his business objects framework that pre-dates .NET itself! Rocky discusses the surge in development that occurred for versi...

23 Okt 202559min

Digging Deeper into .NET Aspire with Chris Klug

Digging Deeper into .NET Aspire with Chris Klug

Aspire has been around for almost two years. How do you use it effectively? Carl and Richard talk to Chris Klug about his experience with .NET Aspire. Chris discusses thinking cloud natively, whether ...

16 Okt 202555min

Valuable Testing with Egil Hansen

Valuable Testing with Egil Hansen

You write tests - but are they valuable tests? Carl and Richard talk to Egil Hansen about his approach to creating tests for applications. Egil discusses the types of testing and who they impact. Test...

9 Okt 202554min

Populært innen Teknologi

lydartikler-fra-aftenposten
romkapsel
teknisk-sett
smart-forklart
elektropodden
energi-og-klima
nasjonal-sikkerhetsmyndighet-nsm
rss-ki-praten
rss-impressions-2
shifter
fornybaren
tomprat-med-gunnar-tjomlid
rss-ai-forklart
rss-heis
teknologi-og-mennesker
i-loopen
rss-alt-vi-kan
rss-alt-som-gar-pa-strom
rss-praktisk-proptech
rss-bouvet-bobler