TestGuild Automation Podcast

TestGuild Automation Podcast

Joe Colantonio
Country USA
Language EN
Episodes 595
Latest 17.11.2026

TestGuild Automation Podcast is a weekly show hosted by Joe Colantonio that delves into software test automation. It covers the latest news in testing, reviews books on automation, and features interviews with industry thought leaders. The podcast aims to share insights from successful software engineers and automation experts.

Episodes

  • Robot Framework Test Automation: Automate Web, Desktop, Mobile, and Embedded Systems
    Robot Framework Test Automation: Automate Web, Desktop, Mobile, and Embedded Systems 17.11.2026 36m
    What makes Robot Framework flexible enough to test medical devices, low code bots, monitoring systems, and embedded hardware, all with one framework? In this RoboCon 2027 special, Joe Colantonio talks with four leaders in the Robot Framework community: Lydia Peabody, Kelby Stine, Simon Meggle, and Linda van de Vooren. They talk about why Robot Framework's library ecosystem lets you test far beyond the browser, and how AI and the Robot Framework MCP server are speeding up test creation. They also explain why human knowledge still matters when tests break. You'll hear how the official style guid...
  • Playwright at Scale: Run 500 Tests in Minutes
    Playwright at Scale: Run 500 Tests in Minutes 10.11.2026 37m
    Is your Playwright suite slowing you down instead of speeding you up? In this episode, Oliver Stenbom, cofounder of Endform, shares what really happens when teams try to scale Playwright from a handful of tests to hundreds, and why AI alone won't fix unreliable tests. Try Endform free with 2,000 included minutes now: https://testgld.link/endform You'll discover why most flaky tests point to real problems in your application, how parallel test runs can expose performance limits you didn't know you had, and why deterministic tests written as code are still a reviewable artifact worth owning in t...
  • How to Prove Your Release Is Ready When AI Writes the Code with Ashwin Kondapalli
    How to Prove Your Release Is Ready When AI Writes the Code with Ashwin Kondapalli 03.11.2026 39m
    How to Prove Your Release Is Ready When AI Writes the Code? Can you prove your software is ready to ship, or does that answer still depend on a meeting and a spreadsheet? Want to see if your team can prove a release is ready? Book a custom LoopIQ demo with Ashwin: https://testgld.link/loopiqdemo In this episode, Joe Colantonio sits down with Ashwin Kondapalli, co-founder and CTO of LoopIQ, to talk about why more tools and more automation haven't made release decisions any easier, and what to do about it. Ashwin shares how LoopIQ connects requirements, tests, security findings, and approvals in...
  • Why Your AI Tests Pass When Your Features Fail with Donovan Brady
    Why Your AI Tests Pass When Your Features Fail with Donovan Brady 27.10.2026 49m
    Why Your AI Tests Pass When Your Features Fail? Donovan Brady of Leapwork shows how to make AI tests traceable, cheaper to run, and safe to self-heal. 👉 Try Leapwork Play (free tier): https://testgld.link/podcastsleapwork AI can write hundreds of tests in minutes. But can you trust what it built? In this TestGuild episode, Joe Colantonio talks with Donovan Brady, VP of Developer Relations at Leapwork, about the biggest problem in AI testing right now: trust. Donovan shares what he's seeing across industries, from bleeding edge teams running fully agentic development to financial services and...
  • Scary Test Automation POCs Made Easy: Halloween Special With Paul Grossman
    Scary Test Automation POCs Made Easy: Halloween Special With Paul Grossman 20.10.2026 42m
    Running a proof of concept on test automation tools can feel like a horror movie. Vendors promise everything, your boss wants answers fast, and you don't know what you don't know. In this Halloween special, Paul Grossman, the Dark Arts Wizard, walks through his free personal automation tool POC checklist and shares the AI and Playwright tricks he's picked up this year. Key takeaways: Use a 177 feature checklist to compare tools side by side, saved locally so your data stays yours, with room to add any tool you find. See how AI driven and codeless tools stack up on build time and run time using...
  • Locust and Azure Load Testing: Create and Debug Load Tests with AI with Lars Holmberg and Abhinav Premsekhar
    Locust and Azure Load Testing: Create and Debug Load Tests with AI with Lars Holmberg and Abhinav Premsekhar 06.10.2026 36m
    Performance testing has never been easier to start, or more important to get right. As teams ship more AI generated code, performance problems are slipping through, and they tend to surface during your highest traffic moments. In this episode, Joe Colantonio talks with Lars Holmberg, lead maintainer of the open source Locust project, and Abhinav Premsekhar of Microsoft's Azure App Testing team. They explain how AI is changing load testing, from script creation to results analysis. You'll see live demos of Azure Load Testing, including: Quick URL based tests for beginners Running existing JMete...
  • AI Agents Passed the Tests. Real Devices Didn't. with Nick Metcalfe
    AI Agents Passed the Tests. Real Devices Didn't. with Nick Metcalfe 29.09.2026 40m
    Cloud device farms make it easy to get started with real device testing. But what happens when you need to scale? Costs climb fast, you wait in a queue for the devices you need, and you lose visibility into what's actually happening when a test fails. In this episode, Nick Metcalfe, Head of Technical Sales Engineering at Cambrionix, joins Joe to explain why more testing teams are bringing their device labs in house. Nick shares how one team was quoted roughly a million dollars a month to outsource their real device testing, then cut that cost to around $300K by building their own lab. And cost...
  • AI Testing Reality Check: What 13 Founders Refuse to Automate with Joe Colantonio
    AI Testing Reality Check: What 13 Founders Refuse to Automate with Joe Colantonio 22.09.2026 29m
    I asked thirteen people inside AI testing one question: can AI test your software for you? Founders, CTOs, project leads, and quality leaders, many of them selling AI testing tools right now. Not one said yes. This episode is my session from the Testear.la 2026 conference, built entirely from twelve months of interviews on this show with the people actually building this technology, including Applitools, Maestro, Bright Security, QA.tech, Cucumber, Ito, and the lead of the Selenium project. In it you'll learn why one AI testing vendor deliberately removed AI from the part where tests run, the...
  • How to Stay Irreplaceable When Agents Write Your Tests with Jonathon Wright
    How to Stay Irreplaceable When Agents Write Your Tests with Jonathon Wright 15.09.2026 34m
    Is AI going to replace software testers, or make them more valuable than they have ever been? Jonathon Wright says both, and in this episode he does not back down from either position. Jonathon Wright has spent thirty years in test automation, going all the way back to WinRunner. He now runs thirty AI agents across twelve screens, he sat with Gartner for their research on agentic platforms, and he says the last six months changed the job more than the previous three decades combined. We get into what he calls confidence engineering, why he has not opened a browser in five years, and what happe...
  • AI Performance Testing: How to Scale Agentic AI with Kandasamy Selvaraj
    AI Performance Testing: How to Scale Agentic AI with Kandasamy Selvaraj 08.09.2026 43m
    Everything you knew about performance testing changes when the system you're testing is non deterministic. In this episode of the TestGuild Automation Podcast, Joe Colantonio sits down with Kandasamy Selvaraj, Principal Architect and author of the free book Rethinking Performance Engineering for Agentic AI, to unpack what it really takes to move an AI agent from a working demo to an enterprise system handling millions of conversations per hour. Checkout his free book: https://leanpub.com/agentic-ai-performance Kandasamy shares the practical playbook he's built running agentic AI in production,...
  • AI Testing Is Bigger Than You Think, 5 Areas Testers Must Own with Swati Seela
    AI Testing Is Bigger Than You Think, 5 Areas Testers Must Own with Swati Seela 01.09.2026 38m
    Most testers are stuck arguing about whether AI is coming for their jobs. Swati Seela thinks that's a distraction from a much more useful question: when we say "AI testing," what do we actually mean? What do you think? Take our TestGuild State of Test Automation Survey now: https://testgld.link/27data In this episode, Swati walks through the AI Testing Landscape, a practical framework she presented at CAST 2026 that breaks AI testing into five overlapping areas: AI assisted testing, AI evaluation and trust, AI development quality, testing products that contain AI functionality, and testing the...
  • Why IoT Testing Proves Manual Testing Never Died with Oleksii Cherkashyn
    Why IoT Testing Proves Manual Testing Never Died with Oleksii Cherkashyn 18.08.2026 35m
    Manual testing never died. IoT is the proof. In this episode, Joe Colantonio talks with Oleksii Cherkashyn, a QA team lead, automation engineer, and IoT testing specialist who built a complete test architecture from scratch across hardware, firmware, mobile, web, and API. IoT breaks the usual automation playbook. You are not testing a shopping cart. You are connecting a real microcontroller, flashing a sketch, validating that a physical command produced the right change in a dashboard widget, and then doing the same thing again through the REST API and the mobile app. No marketplace framework...
  • Testing AI: Engineering Confidence in Non-Deterministic Systems with Jason Arbon
    Testing AI: Engineering Confidence in Non-Deterministic Systems with Jason Arbon 12.08.2026 53m
    In this episode 600 of the TestGuild Automation Podcast, Joe Colantonio talks with Jason Arbon, founder of Testers.ai, Jank.AI and IcebergQA and author of the new book Testing AI: Engineering Confidence in Non-Deterministic Systems. Take Our 2027 Survey Now: https://testgld.link/27data Jason makes a case most testers have not heard yet. Coding is being absorbed by AI. Specification work is thinning out. Product, development, and test roles are converging into one. And when the music stops, the only seat left belongs to the person who can look at what the machine produced and make an evidence b...
  • Playwright With AI: How to Automate Tests Without Shipping AI Slop with Andrew Knight
    Playwright With AI: How to Automate Tests Without Shipping AI Slop with Andrew Knight 04.08.2026 38m
    Your developers just got supercharged by AI coding agents. Your test coverage did not. So how do you keep quality high when product code is shipping faster than any test team can follow? In this episode Andrew Knight, the Automation Panda and Senior Director of Product and Engineering at Cycle Labs, shares how his six person team is running the biggest release quarter in company history using AI coding agents, spec driven development, and Playwright. You will discover: How Playwright turned itself into an AI automation platform with the MCP server, the planner, generator, and healer agents, an...
  • Test Automation Won't Save Your QA Career, but These Skills Will with Keith Klain
    Test Automation Won't Save Your QA Career, but These Skills Will with Keith Klain 28.07.2026 45m
    Keith Klain has spent 25+ years leading enterprise quality programs in financial services and is one of the testing industry's most respected voices. In this episode, he joins Joe to discuss his BrowserStack talk, "The Death of Test Engineering," why testing isn't dying—but outdated testing roles are—and how AI is reshaping the future of software quality. In this episode: Why "The Death of Test Engineering" isn't what you think The difference between checking and testing Will AI replace software testers? Why confidence engineering matters How to communicate testing in business terms Where auto...
  • AI Testing Strategy: Stop Being a Cost Center, Start Protecting Revenue with Nandini Srinivasan
    AI Testing Strategy: Stop Being a Cost Center, Start Protecting Revenue with Nandini Srinivasan 22.07.2026 36m
    Nandini Srinivasan has spent 25 years in the quality industry and leads a global QA organization of over 150 engineers across the US, Canada, India, and Pakistan. In this episode, she breaks down exactly how she built a QA AI acceleration charter, ran a train-the-trainer model, and used a phased proof-of-concept approach to separate real AI from what she calls "powerful automation dressed up as AI. We get into: How she frames quality metrics for executives Using language around revenue protection Risk mitigation Feature velocity instead of test coverage percentages. She talks about the four pi...
  • How to Move from Prompt Engineering to Harness Engineering in Testing with Matt Wynne
    How to Move from Prompt Engineering to Harness Engineering in Testing with Matt Wynne 14.07.2026 39m
    Matt Wynne, co-creator of Cucumber and BDD practitioner, joins Joe for the first time in over a decade to talk about what two years inside a Silicon Valley AI startup taught him about the future of software testing. Matt spent time at Mechanical Orchard working alongside experienced XP practitioners to modernize legacy COBOL mainframes using LLMs, and then spent a week with the team that coined the term "software factory," where the rule was simple: humans never write the code, never read the code. In this episode, Matt breaks down what harness engineering actually means, why shared understand...
  • Agentic Engineering for Testers: How to Automate Your Way to the Top with Amit Rawat
    Agentic Engineering for Testers: How to Automate Your Way to the Top with Amit Rawat 07.07.2026 43m
    Amit Rawat is an agentic engineer who spent two decades in QA before shifting fully into building AI agents. He's the creator of PromptWright, a desktop tool that turns natural language prompts into automated Playwright browser tests, complete with screen recording, Gherkin scenario generation, and self-healing locators. In this episode, Amit and Joe get into what it actually takes to work with AI agents at a high level, starting with why the planning phase matters more than the prompt itself. Amit breaks down his own workflow, brainstorming with AI, building a detailed plan in HTML before eve...
  • How to Test Any API Without Documentation with Liudas Jankauskas
    How to Test Any API Without Documentation with Liudas Jankauskas 30.06.2026 23m
    Most API testing stops at the happy path. The problem is that the bugs that actually hurt you in production are sitting in everything many testers skip, like the boundary values, the oversized payloads, the missing tokens, the security headers, the inputs that make no sense at all. In this episode, Joe sits down with Liudas Jankauskas, who has spent almost twenty years breaking software and testing APIs since 2008. Liudas demonstrates Rentgen, his free and open-source API testing tool, live on screen. You'll watch him take a single request from a real app, map it in seconds, and generate dozen...
  • Your AI Code Review Is Lying to You (Here's the Fix) with Evan Marshall
    Your AI Code Review Is Lying to You (Here's the Fix) with Evan Marshall 23.06.2026 36m
    Your AI code review tools read the diff. They stare at your code. But they never actually run it. So the bugs that only show up at runtime, the broken user flows, the bad query plan, the duplicate submission, sail right past review and land in front of your customers. In this episode, Joe Colantonio sits down with Evan Marshall, founder of Ito and a fifteen year engineer who spent five years in applied cryptography securing hundreds of millions of dollars for millions of people. Evan is taking that ship fast without breaking things discipline and pointing it straight at testing. Ito is an agen...

Popular in

The podcast also appears in the podcast charts of these countries.