Om episode
How do you manage APIs to GenAI, and how can GenAI help with API management? Carl and Richard chat with Andrei Kamenev about the latest features coming to Azure API Management. On the one hand, there are Copilot tools to help craft and understand APIM policies, which can get very complex. Then, there is the provisioning of access to GenAI-related APIs like the Azure OpenAI service, which utilize tokens - and those tokens mean money, so they need to be controlled. The GenAI Gateway provides the ability to rate-limit token issuing and all the other capabilities you expect from APIM. Prompt caching is in preview and can decrease the cost of repeated use of the same prompts. Many of the features are new, and more are coming!
Nyeste episoder
.NET Rocks!
How Simple is as Simple as Possible with Mark Rendle
2024-09-19 • 1h 1min
.NET Rocks!
Making Design Pay with Billy Hollis
2024-09-12 • 1h 6min
.NET Rocks!
Remote Mob Programming with Ulrika Malmgren
2024-09-05 • 51min
.NET Rocks!
Machine Learning on Geospatial Data with Malte Loller-Anderson & Mathilde Ørstavik
2024-08-29 • 54min
.NET Rocks!
Domain Driven Design and Event Sourcing with Anita Kvamme
2024-08-22 • 55min
.NET Rocks!
Low-Code Solutions for .NET Developers with Serge Sarafudinov
2024-08-15 • 59min
.NET Rocks!
Getting into Containers using Aspire with Jiachen Jiang
2024-08-01 • 55min
.NET Rocks!
Building Domain-Specific Copilots with Vishwas Lele
2024-07-25 • 50min
.NET Rocks!
Basic UX for Developers with Hilary Stohs-Krause
2024-07-18 • 55min