Playwright With AI: How to Automate Tests Without Shipping AI Slop with Andrew Knight

Playwright With AI: How to Automate Tests Without Shipping AI Slop with Andrew Knight

Your developers just got supercharged by AI coding agents. Your test coverage did not. So how do you keep quality high when product code is shipping faster than any test team can follow?

In this episode Andrew Knight, the Automation Panda and Senior Director of Product and Engineering at Cycle Labs, shares how his six person team is running the biggest release quarter in company history using AI coding agents, spec driven development, and Playwright.

You will discover:

  • How Playwright turned itself into an AI automation platform with the MCP server, the planner, generator, and healer agents, and the new CLI and skills approach that cuts your token usage way down.
  • Why Andy uses Spec Kit to codify his testing strategy once, in markdown, so quality standards get baked into every single pull request instead of being caught in review.
  • How to decide which AI generated tests are actually worth running when compute time and budget are finite.
  • What AI slop looks like from a manager's seat, and how to build a team culture that catches it before it ships.
  • Why Andy believes AI coding tools are the new compiler and markdown is the new programming language, plus my pushback on what that means for everything testers were trained to care about.
  • What Andy really thinks about token costs, subscription tiers, and what happens when the AI subsidies run out.
  • Plus the one piece of advice he gives to any tester still sitting on the sidelines of the AI shift.

Whether you are an automation engineer, a QA lead, or an engineering manager trying to figure out where testing fits in an AI first workflow, this episode gives you a practical playbook you can start using this week.

Denne episoden er hentet fra en åpen RSS-feed og er ikke publisert av Podme. Den kan derfor inneholde annonser.

Episoder(605)

Testing AI: Engineering Confidence in Non-Deterministic Systems with Jason Arbon

Testing AI: Engineering Confidence in Non-Deterministic Systems with Jason Arbon

In this episode 600 of the TestGuild Automation Podcast, Joe Colantonio talks with Jason Arbon, founder of Testers.ai, Jank.AI and IcebergQA and author of the new book Testing AI: Engineering Confiden...

12 Aug 53min

Test Automation Won't Save Your QA Career, but These Skills Will with Keith Klain

Test Automation Won't Save Your QA Career, but These Skills Will with Keith Klain

Keith Klain has spent 25+ years leading enterprise quality programs in financial services and is one of the testing industry's most respected voices. In this episode, he joins Joe to discuss his Brows...

28 Jul 45min

AI Testing Strategy: Stop Being a Cost Center, Start Protecting Revenue with Nandini Srinivasan

AI Testing Strategy: Stop Being a Cost Center, Start Protecting Revenue with Nandini Srinivasan

Nandini Srinivasan has spent 25 years in the quality industry and leads a global QA organization of over 150 engineers across the US, Canada, India, and Pakistan. In this episode, she breaks down exac...

22 Jul 36min

How to Move from Prompt Engineering to Harness Engineering in Testing with Matt Wynne

How to Move from Prompt Engineering to Harness Engineering in Testing with Matt Wynne

Matt Wynne, co-creator of Cucumber and BDD practitioner, joins Joe for the first time in over a decade to talk about what two years inside a Silicon Valley AI startup taught him about the future of so...

14 Jul 39min

Agentic Engineering for Testers: How to Automate Your Way to the Top with Amit Rawat

Agentic Engineering for Testers: How to Automate Your Way to the Top with Amit Rawat

Amit Rawat is an agentic engineer who spent two decades in QA before shifting fully into building AI agents. He's the creator of PromptWright, a desktop tool that turns natural language prompts into a...

7 Jul 43min

How to Test Any API Without Documentation with Liudas Jankauskas

How to Test Any API Without Documentation with Liudas Jankauskas

Most API testing stops at the happy path. The problem is that the bugs that actually hurt you in production are sitting in everything many testers skip, like the boundary values, the oversized payload...

30 Jun 23min

Your AI Code Review Is Lying to You (Here's the Fix) with Evan Marshall

Your AI Code Review Is Lying to You (Here's the Fix) with Evan Marshall

Your AI code review tools read the diff. They stare at your code. But they never actually run it. So the bugs that only show up at runtime, the broken user flows, the bad query plan, the duplicate sub...

23 Jun 36min

Populært innen Fakta

fastlegen
dine-penger-pengeradet
relasjonspodden-med-dora-thorhallsdottir-kjersti-idem
foreldreradet
treningspodden
jakt-og-fiskepodden
rss-kunsten-a-leve
mikkels-paskenotter
rss-strid-de-norske-borgerkrigene
hverdagspsyken
sinnsyn
fryktlos
gravid-uke-for-uke
rss-sarbar-med-lotte-erik
rss-var-forste-kaffe
kvallm
tomprat-med-gunnar-tjomlid
rss-impressions-2
rss-bak-luftfarten
laringsmiljo-i-skole-og-barnehage-uis-podkast