AI Testing LLMs & RAG: What Testers Must Validate with Imran Ali

AI Testing LLMs & RAG: What Testers Must Validate with Imran Ali

AI is transforming how software is built, but testing AI systems requires an entirely new mindset.

Don't miss AutomationGuild 2026 - Register Now: https://testguild.me/podag26

Use code TestGuildPod20 to get 20% off your ticket.

In this episode, Joe Colantonio sits down with Imran Ali to break down what AI testing really looks like when you're dealing with LLMs, RAG pipelines, and autonomous QA workflows.

You'll learn:

Why traditional pass/fail testing breaks down with LLMs

How to test non-deterministic AI outputs for consistency and accuracy

Practical techniques for detecting hallucinations, grounding issues, and prompt injection risks

How RAG systems change the way testers validate AI-powered applications

Where AI delivers quick wins today—and where human validation still matters

This conversation goes beyond hype and gets into real-world AI testing strategies QA teams are using right now to keep up with AI-generated code, faster release cycles, and DevOps velocity.

If you're a tester, automation engineer, or QA leader wondering how AI changes your role,not replaces it,this episode is your roadmap.

Det här avsnittet är hämtat från ett öppet RSS-flöde och publiceras inte av Podme. Det kan innehålla reklam.

Avsnitt(612)

Locust and Azure Load Testing: Create and Debug Load Tests with AI with Lars Holmberg and Abhinav Premsekhar

Locust and Azure Load Testing: Create and Debug Load Tests with AI with Lars Holmberg and Abhinav Premsekhar

Performance testing has never been easier to start, or more important to get right. As teams ship more AI generated code, performance problems are slipping through, and they tend to surface during you...

6 Okt 36min

AI Agents Passed the Tests. Real Devices Didn't. with Nick Metcalfe

AI Agents Passed the Tests. Real Devices Didn't. with Nick Metcalfe

Cloud device farms make it easy to get started with real device testing. But what happens when you need to scale? Costs climb fast, you wait in a queue for the devices you need, and you lose visibilit...

29 Sep 40min

AI Testing Reality Check: What 13 Founders Refuse to Automate with Joe Colantonio

AI Testing Reality Check: What 13 Founders Refuse to Automate with Joe Colantonio

I asked thirteen people inside AI testing one question: can AI test your software for you? Founders, CTOs, project leads, and quality leaders, many of them selling AI testing tools right now. Not one ...

22 Sep 29min

How to Stay Irreplaceable When Agents Write Your Tests with Jonathon Wright

How to Stay Irreplaceable When Agents Write Your Tests with Jonathon Wright

Is AI going to replace software testers, or make them more valuable than they have ever been? Jonathon Wright says both, and in this episode he does not back down from either position. Jonathon Wright...

15 Sep 34min

AI Performance Testing: How to Scale Agentic AI with Kandasamy Selvaraj

AI Performance Testing: How to Scale Agentic AI with Kandasamy Selvaraj

Everything you knew about performance testing changes when the system you're testing is non deterministic. In this episode of the TestGuild Automation Podcast, Joe Colantonio sits down with Kandasamy ...

8 Sep 43min

AI Testing Is Bigger Than You Think, 5 Areas Testers Must Own with Swati Seela

AI Testing Is Bigger Than You Think, 5 Areas Testers Must Own with Swati Seela

Most testers are stuck arguing about whether AI is coming for their jobs. Swati Seela thinks that's a distraction from a much more useful question: when we say "AI testing," what do we actually mean? ...

1 Sep 38min

Why IoT Testing Proves Manual Testing Never Died with Oleksii Cherkashyn

Why IoT Testing Proves Manual Testing Never Died with Oleksii Cherkashyn

Manual testing never died. IoT is the proof. In this episode, Joe Colantonio talks with Oleksii Cherkashyn, a QA team lead, automation engineer, and IoT testing specialist who built a complete test ar...

18 Aug 35min

Testing AI: Engineering Confidence in Non-Deterministic Systems with Jason Arbon

Testing AI: Engineering Confidence in Non-Deterministic Systems with Jason Arbon

In this episode 600 of the TestGuild Automation Podcast, Joe Colantonio talks with Jason Arbon, founder of Testers.ai, Jank.AI and IcebergQA and author of the new book Testing AI: Engineering Confiden...

12 Aug 53min

Populärt inom Utbildning

rss-bara-en-till-om-beroende-medberoende
historiepodden-se
det-skaver
nu-blir-det-historia
harrisons-dramatiska-historia
rss-viktmedicinpodden
rss-dr-bjorklund
allt-du-velat-veta
not-fanny-anymore
roda-vita-rosen
johannes-hansen-podcast
rss-foraldramotet-bring-lagercrantz
sa-in-i-sjalen
rikatillsammans-om-privatekonomi-rikedom-i-livet
rss-max-tant-med-max-villman
i-vantan-pa-katastrofen
sektledare
rss-ai-med-jonas-benjamin
rss-basta-livet
rss-traningsklubben