Per Kops: Architecture of Ollama and Local LLMs - Episode 342

Per Kops: Architecture of Ollama and Local LLMs - Episode 342

Per is an experienced software architect and developer with more than 19 years of experience in designing, developing, and testing software. He is currently serving as a Distinguished software developer at Delegate, a Microsoft Partner in Denmark.

Topics of Discussion:

[3:02] More about Per's background in nearly two decades in .NET and Azure consulting.

[6:11] The concept of a boutique consultant.

[7:00] Founding ATC-Net to share common .NET libraries and avoid duplicative coding.

[10:02] Building trust with customers by open-sourcing "generic" components.

[11:50] Creating a connector to run Olama (local LLMs) with Semantic Kernel.

[20:08] Why Per "fell in love" with Semantic Kernel's abstraction layers and extension possibilities.

[21:44] The role of vector stores (like Azure Cognitive Search) in retrieval-augmented generation.

[24:33] What do we mean by "vector" in the AI space?

[26:39] What is a "text chunker"?

[31:43] Azure AI search.

[34:07] Finding the right tool for the right task.

Mentioned in this Episode:

Clear Measure Way

Architect Forum

Software Engineer Forum

Programming with Palermo — New Video Podcast! Email us at programming@palermo.net.

Clear Measure, Inc. (Sponsor)

.NET DevOps for Azure: A Developer's Guide to DevOps Architecture the Right Way, by Jeffrey Palermo

atc-net GitHub

Per Kops LinkedIn

Per Kops GitHub

Want to Learn More?

Visit AzureDevOps.Show for show notes and additional episodes.

Jaksot(387)

Chris Wilke: Generated AI Stories - Episode 379

Chris Wilke: Generated AI Stories - Episode 379

Chris has 25 years experience as a seasoned SaaS and AI product leader known for practical, people-first strategies to harness value from Generative AI for operational excellence. Chris developed the ...

8 Joulu 202538min

Alvin Ashcraft: Community Conferences - Episode 378

Alvin Ashcraft: Community Conferences - Episode 378

Alvin is a senior content developer at Microsoft, author, and longtime leader in the .NET developer community. With over 27 years of experience in software development, Alvin has been recognized as a ...

1 Joulu 202528min

Dan Clarke: Personal Productivity - Episode 377

Dan Clarke: Personal Productivity - Episode 377

Dan Clarke is a seasoned software consultant, Microsoft MVP, and founder of Everstack Ltd. Dan is widely known for his contributions to the .NET ecosystem and hosts the Unhandled Exception Podcast.  W...

24 Marras 202541min

Andrew Lock: Testing Frameworks - Episode 376

Andrew Lock: Testing Frameworks - Episode 376

Andrew Lock is a staff software engineer at Datadog and educator whose contributions to the .NET ecosystem have shaped how developers approach modern web applications.  Located in the UK, Andrew is a ...

17 Marras 202532min

Ben Day: SlideSpeaker.AI - Episode 375

Ben Day: SlideSpeaker.AI - Episode 375

Ben Day is a seasoned software consultant and fractional CTO. With over two decades of experience, he brings a blend of hands-on coding expertise, strategic clarity, and people-focused coaching to hel...

10 Marras 202536min

Josh Arzt: 23 Years of .NET - Episode 374

Josh Arzt: 23 Years of .NET - Episode 374

Josh Arzt is a Senior Solutions Architect with 25+ years of experience modernizing systems, solving complex problems, and delivering scalable cloud solutions. He is an expert in software engineering, ...

3 Marras 202543min

Lee Brownhill: The Data Community - Episode 373

Lee Brownhill: The Data Community - Episode 373

Lee Brownhill is a Principal Cloud DBA at Cloud Rede with deep expertise in SQL Server performance tuning and automation. With years of experience across Azure and AWS, Lee helps clients optimize thei...

27 Loka 202538min

Aaron Palermo: Cyber Security and Systems Engineering with AI-Driven Development - Episode 372

Aaron Palermo: Cyber Security and Systems Engineering with AI-Driven Development - Episode 372

Aaron Palermo is a Senior Solutions Architect, DevOps engineer, and all-around cybersecurity expert. He works for a global cybersecurity services company, Appgate. Aaron was last on the show in episod...

20 Loka 202535min

Suosittua kategoriassa Politiikka ja uutiset

aikalisa
rss-ootsa-kuullut-tasta
tervo-halme
ootsa-kuullut-tasta-2
politiikan-puskaradio
rss-vaalirankkurit-podcast
viisupodi
rss-podme-livebox
otetaan-yhdet
et-sa-noin-voi-sanoo-esittaa
rss-asiastudio
the-ulkopolitist
mtv-uutiset-polloraati
rss-polikulaari-humanisti-vastaa-ja-muut-ts-podcastit
rss-kaikki-uusiksi
rss-hyvaa-huomenta-bryssel
rss-merja-mahkan-rahat
rss-kuka-mina-olen
rss-raha-talous-ja-politiikka
rss-tasta-on-kyse-ivan-puopolo-verkkouutiset