Test Automation Won't Save Your QA Career, but These Skills Will with Keith Klain

Keith Klain has spent 25+ years leading enterprise quality programs in financial services and is one of the testing industry's most respected voices. In this episode, he joins Joe to discuss his BrowserStack talk, "The Death of Test Engineering," why testing isn't dying—but outdated testing roles are—and how AI is reshaping the future of software quality.

In this episode:

Why "The Death of Test Engineering" isn't what you think
The difference between checking and testing
Will AI replace software testers?
Why confidence engineering matters
How to communicate testing in business terms
Where automation adds real value
Why agentic AI testing is overhyped

Notable Quotes

"If you look at AI as a competitor, you're screwed. If you look at it as just another tool... it's not a threat."
"Uncertainty in testing is a feature, not a bug."
"If an organization doesn't value testing, you're doing it wrong."
"You can be incredibly confident about something and incredibly wrong."

One Thing to Try This Week

Ask yourself after every critical defect:
"What would the business impact have been if this had gone live?"
It's a simple way to shift conversations from test cases to business risk.

Resources Mentioned

Rethinking Expertise — Harry Collins
How Complex Systems Fail — Richard Cook
Measuring and Managing Performance in Organizations — Robert Austin
Emily Bender
Alex Hanna
Timnit Gebru
Dagmar Monett
Olivia Gambelin
Ed Zitron

Joe's Recommendation: Prophecy

Denne episoden er hentet fra en åpen RSS-feed og er ikke publisert av Podme. Den kan derfor inneholde annonser.

Episoder(605)

Testing AI: Engineering Confidence in Non-Deterministic Systems with Jason Arbon

In this episode 600 of the TestGuild Automation Podcast, Joe Colantonio talks with Jason Arbon, founder of Testers.ai, Jank.AI and IcebergQA and author of the new book Testing AI: Engineering Confiden...

12 Aug 53min

Playwright With AI: How to Automate Tests Without Shipping AI Slop with Andrew Knight

Your developers just got supercharged by AI coding agents. Your test coverage did not. So how do you keep quality high when product code is shipping faster than any test team can follow? In this episo...

4 Aug 38min

AI Testing Strategy: Stop Being a Cost Center, Start Protecting Revenue with Nandini Srinivasan

Nandini Srinivasan has spent 25 years in the quality industry and leads a global QA organization of over 150 engineers across the US, Canada, India, and Pakistan. In this episode, she breaks down exac...

22 Jul 36min

How to Move from Prompt Engineering to Harness Engineering in Testing with Matt Wynne

Matt Wynne, co-creator of Cucumber and BDD practitioner, joins Joe for the first time in over a decade to talk about what two years inside a Silicon Valley AI startup taught him about the future of so...

14 Jul 39min

Agentic Engineering for Testers: How to Automate Your Way to the Top with Amit Rawat

Amit Rawat is an agentic engineer who spent two decades in QA before shifting fully into building AI agents. He's the creator of PromptWright, a desktop tool that turns natural language prompts into a...

7 Jul 43min

How to Test Any API Without Documentation with Liudas Jankauskas

Most API testing stops at the happy path. The problem is that the bugs that actually hurt you in production are sitting in everything many testers skip, like the boundary values, the oversized payload...

30 Jun 23min

Your AI Code Review Is Lying to You (Here's the Fix) with Evan Marshall

Your AI code review tools read the diff. They stare at your code. But they never actually run it. So the bugs that only show up at runtime, the broken user flows, the bad query plan, the duplicate sub...

23 Jun 36min