AI DevOps Podcast24 Mar 2025

Per Kops: Architecture of Ollama and Local LLMs - Episode 342

Per is an experienced software architect and developer with more than 19 years of experience in designing, developing, and testing software. He is currently serving as a Distinguished software developer at Delegate, a Microsoft Partner in Denmark.

Topics of Discussion:

[3:02] More about Per's background in nearly two decades in .NET and Azure consulting.

[6:11] The concept of a boutique consultant.

[7:00] Founding ATC-Net to share common .NET libraries and avoid duplicative coding.

[10:02] Building trust with customers by open-sourcing "generic" components.

[11:50] Creating a connector to run Olama (local LLMs) with Semantic Kernel.

[20:08] Why Per "fell in love" with Semantic Kernel's abstraction layers and extension possibilities.

[21:44] The role of vector stores (like Azure Cognitive Search) in retrieval-augmented generation.

[24:33] What do we mean by "vector" in the AI space?

[26:39] What is a "text chunker"?

[31:43] Azure AI search.

[34:07] Finding the right tool for the right task.

Mentioned in this Episode:

Clear Measure Way

Architect Forum

Software Engineer Forum

Programming with Palermo — New Video Podcast! Email us at programming@palermo.net.

Clear Measure, Inc. (Sponsor)

.NET DevOps for Azure: A Developer's Guide to DevOps Architecture the Right Way, by Jeffrey Palermo

atc-net GitHub

Per Kops LinkedIn

Per Kops GitHub

Want to Learn More?

Visit AzureDevOps.Show for show notes and additional episodes.

Denne episoden er hentet fra en åpen RSS-feed og er ikke publisert av Podme. Den kan derfor inneholde annonser.

Episoder(417)

Jeffrey Palermo: AI-Driven Software Projects - Episode 418

https://clearmeasure.com/developers/forums/

7 Sep 18min

Joseph Guadagno: Architecture for AI Development - Episode 417

https://clearmeasure.com/developers/forums/ Joseph Guadagno is an experienced executive level software leader and architect over 30 years of software development experience and a Microsoft MVP since...

31 Aug 42min

Anna Hoffman: AI Database Development - Episode 416

https://clearmeasure.com/developers/forums/ Anna Hoffman is a Principal Group Product Manager for Azure Data on Microsoft's SQL Engineering team, where she works across SQL Server, Azure SQL, and SQ...

24 Aug 48min

Mark Seemann: AI Code Quality - Episode 415

https://clearmeasure.com/developers/forums/ Mark Seemann is a self-employed programmer and software architect based in Copenhagen, Denmark, and the author of Code That Fits in Your Head and Dependenc...

17 Aug 49min

Jimmy Bogard: AI-Driven Development - Episode 414

https://clearmeasure.com/developers/forums/ Today's guest is a true heavyweight in the .NET open-source world — someone whose work has quietly, but profoundly, shaped the way countless developers bu...

10 Aug 42min

John Bristowe: Octopus Catchup - Episode 413

https://clearmeasure.com/developers/forums/ John Bristowe brings over 20 years of experience in technology to his role as Developer Advocate at Octopus Deploy. His career includes time at Progress a...

3 Aug 36min

Blake Caraway: AI in Business Operations - Episode 412

https://clearmeasure.com/developers/forums/ Blake Caraway is the General Manager of Texas Multi-Chem, Ltd., a Texas Hill Country company where he has spent over a decade transforming daily operations ...

27 Jul 44min

Michael Nygard: AI - Episode 411

https://clearmeasure.com/developers/forums/ Michael Nygard advises consulting firms, private equity teams, CTOs, CEOs, and boards when they require senior technology judgment for limited-term, high-...

20 Jul 45min