From Specs to Monitoring: A CTO's Guide to QA Best Practices
How Many CTOs7 Loka 2025

From Specs to Monitoring: A CTO's Guide to QA Best Practices

In this episode of "How Many CTOs Does It Take?" podcast, hosts Scott Porad and Brad Hefta-Gaub tackle the evolving landscape of quality assurance in web apps.

They challenge the notion of QA as just "manual testers at the end," instead framing quality as a chain of practices across the entire SDLC: requirements, technical design, code reviews, unit tests, automation, monitoring, and stakeholder demos.

Topics include:

  • Why QA begins upstream with clear requirements and design, not just testing at the end

  • The role of test automation and real user monitoring (RUM) in catching defects before users do

  • Code review culture as a cornerstone of quality (and why reviewers should run the code)

  • Balancing QA investment for startups vs. enterprise-grade systems

  • A proposed ROI heuristic for test automation (risk, cost of failure, complexity, churn, compliance)

  • The role of AI in QA: pair code reviews, vibe coding risks, and the future of end-to-end automation

  • How context-rich prompts (and even teaching AI like you'd teach a junior dev) improve code quality

  • Why quality assurance is ultimately a cultural mindset, not just a checklist

The episode closes with an anecdote on peanut butter & jelly sandwiches, illustrating how precise instructions (and context) are at the heart of both QA and AI development.

  • 00:00 Introduction to User Interaction Testing in AI
  • 00:29 Welcome to the Podcast
  • 00:42 Discussing QA Standards in Web Apps
  • 01:22 Philosophical Approach to Quality Assurance
  • 03:19 Importance of Test Automation and Monitoring
  • 06:15 Real User Monitoring and Production Safety Nets
  • 08:32 Challenges with Requirements and Product Debt
  • 10:10 Sprint Demos and Stakeholder Reviews
  • 15:33 Code Reviews and Implementation Plans
  • 16:59 AI in Code Reviews and Pair Programming
  • 18:39 Balancing Investment in QA for Startups
  • 20:56 Evaluating Risk and Investment in Test Automation
  • 22:47 The Importance of Code Reviews and Unit Tests
  • 26:23 Challenges and Strategies in AI-Driven Development
  • 32:48 The Role of Context in AI and QA
  • 36:20 Concluding Thoughts and Anecdotes

Resources:

#TechPodcast #EngineeringPodcast #DevTalks #PodcastForDevs #HowManyCtos #Podcast #Ctos #CtoPodcast #Technology #Engineering #SoftwareDevelopment #TechLeadership #EngineeringLeadership #SoftwareQuality #QA #QualityAssurance #TestAutomation #CodeReviews #EngineeringCulture #AIinTesting

Jaksot(66)

The Documented SDLC: Why Every Team Needs One (and When)

The Documented SDLC: Why Every Team Needs One (and When)

In this episode of "How Many CTOs Does It Take?" podcast, hosts Scott Porad and Brad Hefta-Gaub start with a quick retrospective, or is it an encore, of recent rock concerts before stage-diving into a...

21 Loka 202557min

Navigating BADD vs. FaDD: Strategic Refactoring in Software Development

Navigating BADD vs. FaDD: Strategic Refactoring in Software Development

In this episode of "How Many CTOs Does It Take?" podcast, hosts Scott Porad and Brad Hefta-Gaub dive deep into the engineering crossroads between Better Architecture Driven Development (BADD) and Feat...

14 Loka 202537min

Deploys, Demos, and the Elusive Metric of Engineering Productivity

Deploys, Demos, and the Elusive Metric of Engineering Productivity

In this episode of "How Many CTOs Does It Take?" podcast, hosts Scott Porad and Brad Hefta-Gaub wrestle with one of the industry's toughest questions: How do you measure engineering productivity? The ...

30 Syys 202551min

Product Debt: The Hidden Drag on Innovation

Product Debt: The Hidden Drag on Innovation

In this episode of "How Many CTOs Does It Take?" podcast, hosts Scott Porad and Brad Hefta-Gaub dive into the concept of product debt: what it is, how it differs from technical debt, and why it matter...

23 Syys 202534min

From Streaker Apps to AI Safety Loopholes: What CTOs Need to Know

From Streaker Apps to AI Safety Loopholes: What CTOs Need to Know

In this episode of "How Many CTOs Does It Take?" podcast, hosts Scott Porad and Brad Hefta-Gaub break down the quirky and serious sides of today's AI. They cover vibe coding, smart glasses, debugging ...

16 Syys 202540min

Do Engineering Managers Need to Code? Leveling, Calibration & Craft

Do Engineering Managers Need to Code? Leveling, Calibration & Craft

In this episode of "How Many CTOs Does It Take?" podcast, hosts Scott Porad and Brad Hefta-Gaub delve into the art and science of engineering leveling frameworks. From performance reviews to competenc...

10 Syys 202539min

From Prompts to Product: How AI is Changing Software Development

From Prompts to Product: How AI is Changing Software Development

In this episode of "How Many CTOs Does It Take?" podcast, hosts Scott Porad and Brad Hefta-Gaub explore the evolving reality of AI productivity, and what it means for software engineering, product man...

2 Syys 202535min

Suosittua kategoriassa Liike-elämä ja talous

sijotuskasti
mimmit-sijoittaa
rss-rahapodi
psykopodiaa-podcast
herrasmieshakkerit
rss-rahamania
ostan-asuntoja-podcast
hyva-paha-johtaminen
rss-sami-miettinen-neuvottelija
rahapuhetta
rss-lahtijat
rss-doulapodi
rss-paasipodi
juristipodi
rss-sisalto-kuntoon
rss-muutoksenanatomiaa-podcast
rss-startup-ministerio
rss-uppoava-vn-laiva
rss-bisnesta-bebeja
rss-seuraava-potilas