Azure API Management's GenAI Gateway with Andrei Kamenev
.NET Rocks!7 Elo 2024

Azure API Management's GenAI Gateway with Andrei Kamenev

How do you manage APIs to GenAI, and how can GenAI help with API management? Carl and Richard chat with Andrei Kamenev about the latest features coming to Azure API Management. On the one hand, there are Copilot tools to help craft and understand APIM policies, which can get very complex. Then, there is the provisioning of access to GenAI-related APIs like the Azure OpenAI service, which utilize tokens - and those tokens mean money, so they need to be controlled. The GenAI Gateway provides the ability to rate-limit token issuing and all the other capabilities you expect from APIM. Prompt caching is in preview and can decrease the cost of repeated use of the same prompts. Many of the features are new, and more are coming!

Tämä jakso on lisätty Podme-palveluun avoimen RSS-syötteen kautta eikä se ole Podmen omaa tuotantoa. Siksi jakso saattaa sisältää mainontaa.

Jaksot(2001)

Data Centers in Space Geek Out

Data Centers in Space Geek Out

Do data centers in space make any sense? Time for a rare summer-time Geek Out! Richard chats with Carl about all the hype surrounding building orbital data centers for AI workloads. Richard points out...

17 Kesä 1h 17min

Event Sourcing using Cratis with Einar Ingebrigsten

Event Sourcing using Cratis with Einar Ingebrigsten

Can tooling make event sourcing implementations easier? Carl and Richard talk to Einar Ingebrigsten about his work on cratis.io - a set of open-source tools for implementing event sourcing in your app...

11 Kesä 54min

Daemonic AI with Emmz Rendle

Daemonic AI with Emmz Rendle

Is it time to build your own agent harness? Carl and Richard talk to Emmz Rendle about her work on Daemonic AI, which gives you more control over which models and tooling you use to build software wit...

4 Kesä 58min

Ten Things Scott Sauber Does On Every .NET App

Ten Things Scott Sauber Does On Every .NET App

What settings, configurations, and workflows do you use for every .NET app? Carl and Richard talk to Scott Sauber about his list - from organizing folders by feature, to logging, security, and testing...

28 Touko 55min

Using AI to Measure Quality of AI with Vishwas Lele

Using AI to Measure Quality of AI with Vishwas Lele

Large Language Models can generate a lot of text - but is it any good? Carl and Richard talk to Vishwas Lele about his ongoing efforts at pWin.ai to build tools for responding to government RFPs. Vish...

21 Touko 58min

Use What Works with Dylan Beattie

Use What Works with Dylan Beattie

Use What Works! Carl and Richard talk to Dylan Beattie about the Use What Works movement, encouraging developers to use well-maintained open-source projects available today rather than rolling their o...

14 Touko 56min

.NET Nanoframework with José Simões

.NET Nanoframework with José Simões

Ready to go nano? Carl and Richard talk to José Simões about the open source .NET nanoFramework - a community-driven project to provide .NET for embedded systems. José talks about the evolution from t...

6 Touko 55min

Episode 2000!

Episode 2000!

Recorded live at the Tavern Hall in Bellevue during the Party with Palermo for the MVP Summit, it's episode 2000! Carl and Richard take questions from the audience and play clips from past guests and ...

30 Huhti 1h 38min