Elena Samuylova on Large Language Model (LLM) Based Application Evaluation and LLM as a Judge

Elena Samuylova on Large Language Model (LLM) Based Application Evaluation and LLM as a Judge

In this podcast, InfoQ spoke with Elena Samuylova from Evidently AI, on best practices in evaluating Large Language Model (LLM) based applications. She also discussed the tools for evaluating, testing and monitoring applications powered by AI technologies. Read a transcript of this interview: https://bit.ly/4mHAKvN Subscribe to the Software Architects’ Newsletter for your monthly guide to the essential news and experience from industry peers on emerging patterns and technologies: www.infoq.com/software-architects-newsletter Upcoming Events: InfoQ Dev Summit Munich (October 15-16, 2025) Essential insights on critical software development priorities. devsummit.infoq.com/conference/munich2025 QCon San Francisco 2025 (November 17-21, 2025) Get practical inspiration and best practices on emerging software trends directly from senior software developers at early adopter companies. qconsf.com/ QCon AI New York 2025 (December 16-17, 2025) ai.qconferences.com/ QCon London 2026 (March 16-19, 2026) qconlondon.com/ The InfoQ Podcasts: Weekly inspiration to drive innovation and build great teams from senior software leaders. Listen to all our podcasts and read interview transcripts: - The InfoQ Podcast www.infoq.com/podcasts/ - Engineering Culture Podcast by InfoQ www.infoq.com/podcasts/#engineering_culture - Generally AI: www.infoq.com/generally-ai-podcast/ Follow InfoQ: - Mastodon: techhub.social/@infoq - X: x.com/InfoQ?from=@ - LinkedIn: www.linkedin.com/company/infoq/ - Facebook: www.facebook.com/InfoQdotcom# - Instagram: www.instagram.com/infoqdotcom/?hl=en - Youtube: www.youtube.com/infoq - Bluesky: bsky.app/profile/infoq.com Write for InfoQ: Learn and share the changes and innovations in professional software development. - Join a community of experts. - Increase your visibility. - Grow your career. www.infoq.com/write-for-infoq

Det här avsnittet är hämtat från ett öppet RSS-flöde och publiceras inte av Podme. Det kan innehålla reklam.

Avsnitt(385)

Cloud and DevOps InfoQ Trends Report 2026: AI, Resilience, Platforms, FinOps, and Sovereignty

Cloud and DevOps InfoQ Trends Report 2026: AI, Resilience, Platforms, FinOps, and Sovereignty

In this episode of the podcast, members of the InfoQ editorial staff and friends of InfoQ will discuss current trends in the cloud and DevOps domains as part of our annual trends report. These reports...

12 Aug 50min

WebAssembly on the JVM: Feature Evolution, Performance, and the Transition to Endive

WebAssembly on the JVM: Feature Evolution, Performance, and the Transition to Endive

Andrea Peruffo discusses the evolution of WebAssembly beyond the browser and its growing role on the server-side JVM. He covers performance advancements in Wasm runtimes, moving from interpreters to e...

3 Aug 34min

Rethinking Data: Moving From the Traditional Three-Tier Web Stack to Client-Side Event Sourcing

Rethinking Data: Moving From the Traditional Three-Tier Web Stack to Client-Side Event Sourcing

Johannes Schickling explores how he moved beyond the traditional three-tier web stack to a local-first approach. He shares his experience transitioning from Prisma to developing Overtone—a music curat...

27 Juli 43min

Strands Agents with Clare Liguori

Strands Agents with Clare Liguori

In this episode, Thomas Betts talks with Clare Liguori, the technical lead on the open source Strands Agents SDK. The conversation covers how Strands Agents has grown from a Python SDK to a full agent...

20 Juli 38min

Governance in the Age of AI: A Conversation with Sarah Wells

Governance in the Age of AI: A Conversation with Sarah Wells

In this podcast Michael Stiefel spoke to Sarah Wells about the relationship of governance to software architecture. Governance enables teams to work effectively by establishing procedures that minimiz...

13 Juli 48min

Spite-Driven Engineering: A New Blueprint for Cloud Security in the AI Native Era

Spite-Driven Engineering: A New Blueprint for Cloud Security in the AI Native Era

In this episode, Alex Zenla (CTO/Co-founder, Edera) challenges the "laissez-faire" attitude toward modern infrastructure. She promotes "spite-driven development", building software to solve genuine te...

6 Juli 40min

Architectural Patterns: Moving Beyond Cloud-Native to Local-First - Insights from Adam Wiggins

Architectural Patterns: Moving Beyond Cloud-Native to Local-First - Insights from Adam Wiggins

In this episode, Heroku co-founder and Ink & Switch founder Adam Wiggins argues for a 'local-first' architecture that reconciles cloud-based collaboration with the performance and data ownership of lo...

29 Juni 38min

How eBPF Empowers Developers to Observe Inside the Linux Kernel in a Safe and Unintrusive Way

How eBPF Empowers Developers to Observe Inside the Linux Kernel in a Safe and Unintrusive Way

Daniel Finneran explores how eBPF has evolved far beyond its roots in packet filtering into a robust, safe way to extend the Linux kernel. He explains how the eBPF "verifier", the security guardrail, ...

22 Juni 43min

Populärt inom Teknik

uppgang-och-fall
market-makers
rss-uppgang-och-fall
skogsforum-podcast
 och-bilen-gar-bra
rss-laddstationen-med-elbilen-i-sverige
rss-elektrikerpodden
elbilsveckan
developers-mer-an-bara-kod
bosse-bildoktorn-och-hasse-p
rss-en-ai-till-kaffet
bli-saker-podden
rss-veckans-ai
rss-fabriken-2
natets-morka-sida
rss-milpodden
rss-jonas-jaani-podcast
rss-upplyst-entreprenordirektor
hej-bruksbil
rss-teknikstrul-podcast