Azure API Management's GenAI Gateway with Andrei Kamenev
.NET Rocks!7 Aug 2024

Azure API Management's GenAI Gateway with Andrei Kamenev

How do you manage APIs to GenAI, and how can GenAI help with API management? Carl and Richard chat with Andrei Kamenev about the latest features coming to Azure API Management. On the one hand, there are Copilot tools to help craft and understand APIM policies, which can get very complex. Then, there is the provisioning of access to GenAI-related APIs like the Azure OpenAI service, which utilize tokens - and those tokens mean money, so they need to be controlled. The GenAI Gateway provides the ability to rate-limit token issuing and all the other capabilities you expect from APIM. Prompt caching is in preview and can decrease the cost of repeated use of the same prompts. Many of the features are new, and more are coming!

Denne episoden er hentet fra en åpen RSS-feed og er ikke publisert av Podme. Den kan derfor inneholde annonser.

Episoder(2010)

Beside, Inside, and Outside AI with Chad Michel

Beside, Inside, and Outside AI with Chad Michel

What's the best way to interact with an LLM in applications? Carl and Richard talk to Chad Michel about the evolving user interface to large language models. Chad recalls Build 2023, where Technical F...

20 Aug 56min

OpenClaw with David Guttman

OpenClaw with David Guttman

What can OpenClaw do for you? Carl and Richard talk to David Guttman about his work on OpenClaw, and helping others be successful with it.OpenClaw was one of the first personal agents released and has...

12 Aug 57min

Catching Up with Shawn Wildermuth

Catching Up with Shawn Wildermuth

What's Shawn been up to lately? Carl and Richard chat with Shawn Wildermuth about his work in the Netherlands. Shawn talks about his last show on being a senior developer - and how much that has chang...

5 Aug 55min

Identity is Hard with Michele Bustamante

Identity is Hard with Michele Bustamante

Identity is hard, and getting harder! Carl and Richard talk to Michele Bustamante about the evolution of authentication and authorization in the current landscape. Michele talks about finding apps at ...

30 Jul 1h 3min

Commercial Open Source Update with Jimmy Bogard

Commercial Open Source Update with Jimmy Bogard

Last year Jimmy Bogard released commercial licensed versions of AutoMapper and Mediatr - how's it going? Carl and Richard chat with Jimmy about the decision to go commercial and what he's learned afte...

23 Jul 56min

The Role of AI in Testing with Debbie O'Brien

The Role of AI in Testing with Debbie O'Brien

How has testing changed in the era of AI? Carl and Richard talk to Debbie O'Brien in her new role at Zephyr about using LLMs to help build and validate tests - and much more. Debbie talks about joinin...

16 Jul 53min

Open Source Maintenance Fee Update with Rob Mensching

Open Source Maintenance Fee Update with Rob Mensching

The Open Source Maintenance Fee is more than a year old now - how are things going? Carl and Richard catch up with Rob Mensching to discuss the OSMF and its success in supporting Rob's WiX Toolset pro...

8 Jul 58min

Azure Container Apps with Paul Yuknewicz and Jan Kalis

Azure Container Apps with Paul Yuknewicz and Jan Kalis

Have you checked out Azure Container Apps lately? Carl and Richard talk to Paul Yuknewicz and Jan Kalis about how they have sped up startup time with Container Apps using a feature called Express, and...

2 Jul 58min

Populært innen Teknologi

lydartikler-fra-aftenposten
teknisk-sett
tomprat-med-gunnar-tjomlid
elektropodden
rss-ki-praten
smart-forklart
fornybaren
rss-ai-forklart
shifter
rss-bouvet-bobler
teknologi-og-mennesker
rss-alt-som-gar-pa-strom
rss-fisketimen
nasjonal-sikkerhetsmyndighet-nsm
rss-polypod
rss-fish-ships
digital-forretningsforstaelse
rss-kunstig-intelligens-med-elisabeth-maren-og-morten
rss-alt-vi-kan
energi-og-klima