Azure API Management's GenAI Gateway with Andrei Kamenev
.NET Rocks!7 Aug 2024

Azure API Management's GenAI Gateway with Andrei Kamenev

How do you manage APIs to GenAI, and how can GenAI help with API management? Carl and Richard chat with Andrei Kamenev about the latest features coming to Azure API Management. On the one hand, there are Copilot tools to help craft and understand APIM policies, which can get very complex. Then, there is the provisioning of access to GenAI-related APIs like the Azure OpenAI service, which utilize tokens - and those tokens mean money, so they need to be controlled. The GenAI Gateway provides the ability to rate-limit token issuing and all the other capabilities you expect from APIM. Prompt caching is in preview and can decrease the cost of repeated use of the same prompts. Many of the features are new, and more are coming!

Denne episoden er hentet fra en åpen RSS-feed og er ikke publisert av Podme. Den kan derfor inneholde annonser.

Episoder(2001)

Data Centers in Space Geek Out

Data Centers in Space Geek Out

Do data centers in space make any sense? Time for a rare summer-time Geek Out! Richard chats with Carl about all the hype surrounding building orbital data centers for AI workloads. Richard points out...

17 Jun 1h 17min

Event Sourcing using Cratis with Einar Ingebrigsten

Event Sourcing using Cratis with Einar Ingebrigsten

Can tooling make event sourcing implementations easier? Carl and Richard talk to Einar Ingebrigsten about his work on cratis.io - a set of open-source tools for implementing event sourcing in your app...

11 Jun 54min

Daemonic AI with Emmz Rendle

Daemonic AI with Emmz Rendle

Is it time to build your own agent harness? Carl and Richard talk to Emmz Rendle about her work on Daemonic AI, which gives you more control over which models and tooling you use to build software wit...

4 Jun 58min

Ten Things Scott Sauber Does On Every .NET App

Ten Things Scott Sauber Does On Every .NET App

What settings, configurations, and workflows do you use for every .NET app? Carl and Richard talk to Scott Sauber about his list - from organizing folders by feature, to logging, security, and testing...

28 Mai 55min

Using AI to Measure Quality of AI with Vishwas Lele

Using AI to Measure Quality of AI with Vishwas Lele

Large Language Models can generate a lot of text - but is it any good? Carl and Richard talk to Vishwas Lele about his ongoing efforts at pWin.ai to build tools for responding to government RFPs. Vish...

21 Mai 58min

Use What Works with Dylan Beattie

Use What Works with Dylan Beattie

Use What Works! Carl and Richard talk to Dylan Beattie about the Use What Works movement, encouraging developers to use well-maintained open-source projects available today rather than rolling their o...

14 Mai 56min

.NET Nanoframework with José Simões

.NET Nanoframework with José Simões

Ready to go nano? Carl and Richard talk to José Simões about the open source .NET nanoFramework - a community-driven project to provide .NET for embedded systems. José talks about the evolution from t...

6 Mai 55min

Episode 2000!

Episode 2000!

Recorded live at the Tavern Hall in Bellevue during the Party with Palermo for the MVP Summit, it's episode 2000! Carl and Richard take questions from the audience and play clips from past guests and ...

30 Apr 1h 38min

Populært innen Teknologi

lydartikler-fra-aftenposten
romkapsel
teknisk-sett
tomprat-med-gunnar-tjomlid
energi-og-klima
hans-petter-og-co
nasjonal-sikkerhetsmyndighet-nsm
teknologi-og-mennesker
elektropodden
shifter
fornybaren
rss-ki-praten
rss-ai-forklart
rss-polypod
rss-snakk-om-sikkerhet
rss-alt-som-gar-pa-strom
rss-heis
rss-digitaliseringspadden
rss-bouvet-bobler
handlevogna