Azure API Management's GenAI Gateway with Andrei Kamenev
.NET Rocks!7 Aug 2024

Azure API Management's GenAI Gateway with Andrei Kamenev

How do you manage APIs to GenAI, and how can GenAI help with API management? Carl and Richard chat with Andrei Kamenev about the latest features coming to Azure API Management. On the one hand, there are Copilot tools to help craft and understand APIM policies, which can get very complex. Then, there is the provisioning of access to GenAI-related APIs like the Azure OpenAI service, which utilize tokens - and those tokens mean money, so they need to be controlled. The GenAI Gateway provides the ability to rate-limit token issuing and all the other capabilities you expect from APIM. Prompt caching is in preview and can decrease the cost of repeated use of the same prompts. Many of the features are new, and more are coming!

Episoder(1994)

Serverless Elastic with Ken Exner

Serverless Elastic with Ken Exner

What if you could use ElasticSearch serverless? While at Build, Carl and Richard chatted with Ken Exner about the new announcements around Elastic providing serverless storage and search! Ken talks ab...

28 Mai 202541min

C# Networking with Chris Woodruff

C# Networking with Chris Woodruff

Do you understand how networking works in C#? Carl and Richard chat with Chris Woody Woodruff about his new book on networking with C#. Chris runs down the fundamentals of networking and then discusse...

22 Mai 20251h 2min

Backend for Frontend Security Framework with Erwin van der Valk

Backend for Frontend Security Framework with Erwin van der Valk

How do you secure browser-based frontends with ASP.NET Core backends? Carl and Richard discuss the Backend for Frontend (BFF) Security Framework with Erwin van der Valk. Erwin talks about Sam Newman's...

15 Mai 202550min

Architecture vs Code with Steve Smith

Architecture vs Code with Steve Smith

How do you balance architecture and code? Carl and Richard talk to Steve Smith about various architectural strategies and the swing back-and-forth against over-designing architecture and getting code ...

8 Mai 202553min

The Open Source Maintenance Fee with Rob Mensching

The Open Source Maintenance Fee with Rob Mensching

Open Source Maintainers are burning out or going commercial - how do we solve this? Carl and Richard chat with Rob Mensching about his work to create the open source maintenance fee through GitHub. Ro...

1 Mai 20251h 5min

AI for Government RFPs with Vishwas Lele

AI for Government RFPs with Vishwas Lele

How can a large language model help your organization answer government RFPs? Carl and Richard talk to Vishwas Lele about his startup pWin, as in proposal win. Vishwas talks about being a year into th...

24 Apr 202555min

Audio-Video in .NET with Elias Puurunen

Audio-Video in .NET with Elias Puurunen

Can you integrate performant audio-video into your .NET application? Carl and Richard talk to Elias Puurunen about his work at Tractus Events, where he uses the NDI protocols to bring real-time audio ...

16 Apr 20251h 6min

Agentic AI in .NET with Spencer Schneidenbach

Agentic AI in .NET with Spencer Schneidenbach

Ready to build an agentic AI in .NET? Carl and Richard talk to Spencer Schneidenbach about his work using large language models to enhance customer interactions in healthcare. Spencer discusses using ...

10 Apr 202555min

Populært innen Teknologi

lydartikler-fra-aftenposten
romkapsel
teknisk-sett
tomprat-med-gunnar-tjomlid
nasjonal-sikkerhetsmyndighet-nsm
rss-impressions-2
elektropodden
fornybaren
shifter
rss-alt-som-gar-pa-strom
smart-forklart
hans-petter-og-co
teknologi-og-mennesker
kunstig-intelligens-med-morten-goodwin
energi-og-klima
rss-fish-ships
rss-ai-forklart
rss-for-alarmen-gar
rss-brukbart
kortslutning