Software Testing Unleashed - QA, DevEx & Quality Engineering
Richard Seidl | Software Development & Testing Expert
0
Software Testing Unleashed is a weekly podcast hosted by Richard Seidl, a renowned expert in software development and testing. The show explores modern quality engineering, covering topics like smart automation, AI in testing, and developer experience. Each episode features insights from industry leaders, bridging theory and practical execution for QA engineers, developers, and tech leaders.
Episodes
-
GenAI Evaluation: One Model, Three Goals - Deepshikha, Anamika Mukhopadhyay 19.11.2026 27mGenAI evaluation turns into a question of better or worse once every answer a model gives could be correct, and that is where Deepshikha and Anamika Mukhopadhyay begin. We talk about why one model needs three different definitions of good as a customer bot, a clinical summarizer and a coding agent, and why most teams they meet in workshops measure whatever their tools give them by default. A faithfulness score like 0.87279 left a room of CXOs asking whether it was a rounding problem; a 12 percent drop in issue resolution and 200 extra tickets did not. And a prepared Reddit post shows how an in... -
Contract-Driven Testing in Banking: Realistic Mocks - Phil Royston 12.11.2026 30mContract-driven testing lets a tester work against a realistic mock instead of waiting for 50 integrated systems to behave, and that is what Phil Royston is bringing into a large bank. We talk about why mocks built on a developer's imagination produce unreliable tests, how agreed contract tests turn into mocks for API consumer and provider, and why the pitch to senior management fits on one slide while the middle managers hold the veto. Phil also explains why approved business requirements were not testable ones, what he means by parasitic end-to-end testing, and why his advice to any test man... -
Building Trust in Teams: Start Small - Michael Kutz, Linda Van De Vooren 05.11.2026 42mBuilding trust in teams starts with far smaller things than a team-building event, and that is what I talk through with Michael Kutz and Linda Van De Vooren. Michael brings Stephen Covey's waves of trust, from self-trust outward, and his rule that a kept promise about one issue in the code base is one of the Lego stones trust is built from. Linda talks about the inner critic she has practiced with for over ten years, about limitless honesty with a new client, and about why rest and fun come first. We also get into a 50,000 credit limit that became 500,000 through one extra zero, who owns the f... -
Mental Skills: Testers Can't Outsource Their Brain to AI - Ard Kramer 29.10.2026 18mMental skills keep testers thinking when AI offers to do it for them, and Ard Kramer puts it bluntly: you can't outsource your brain. With him I talk about why an idle brain loses its connections, how his cue HAH (human, AI, human) keeps the thinking on our side, and which four skills get a tester into the flow: goal setting, visualization, self-talk and stress control. Ard turns the test goal around, because one passing test confirms nothing, so his hypothesis aims at the moment the payment interface fails. He also explains the Zeigarnik effect, why an open task keeps your subconscious busy o... -
Testing AI Models as Magic Boxes: Why Checks Fail - Michael Bolton 22.10.2026 28mTesting AI models means testing a magic box: nobody has the source code, and the behavior is neither controlled nor understood. Michael Bolton calls that strongly magical, and with him I talk about what follows from it. His principles are simple: if something matters very much, don't depend on magic, and if you use it anyway, responsibility demands that you test it and maximize testability. Simple output checks don't stand a chance against a language model, so testing becomes experiencing, exploring and experimenting, like peeling an onion. And Penn and Teller's clear plastic cups show why we... -
Dark Side of Testing: The Failures We Cause Ourselves - Bart Knaack 15.10.2026 19mTesting is supposed to prevent failures in production, yet sometimes the test itself is what breaks things. Bart Knaack calls this the dark side of testing, and we talk about test data leaking out of poorly protected environments, test systems that give attackers a look at your code, and why testing in production needs a risk assessment of its own. Bart would rather ask questions than hand out checklists, because a ticked box stops people thinking. He also tells the story of a team with 10,000 end-to-end test cases that ended up needing only 50. -
Quality Hunting: Testing for Information Instead of Bugs - Rik Marselis 08.10.2026 18mQuality hunting grew out of Rik Marselis's frustration with bug hunting, and I wanted to know how it works when the goal is information about quality. Rik walks me through a session: teams of about four people, three hours of exploratory testing and a goal agreed up front by asking stakeholders what would help them sleep well at night. He explains why the report structure comes first, why the prize should stay small and why the point just before several sprints go to production suits a hunt well. -
On-Site Testing Conferences: Why Networking Needs Presence - Okan Çakmak 01.10.2026 17mWhat does it take to turn a risky one-time event into a conference that testers travel across borders for? With Okan Çakmak I talk about how the Istanbul Software Testing Conference grew out of something missing: after the pandemic, the big Turkish testing events stayed online, and people lost the chance to meet, network and hug each other in person. He tells me how the team wondered whether 50 or 100 people would come, then welcomed 200, and how the "light in their eyes" of those first participants convinced them to keep going. -
You Need a Test Automation Strategy Before AI - Michaël Pilaeten 24.09.2026 22mWhat happens when AI ships poor quality faster, and nobody notices because the pipeline stays green? With Michaël Pilaeten I talk about why test automation without a clear strategy is a problem that AI only accelerates, not solves. We get into the question of what separates a tester from a test automation engineer, why those two roles need each other but are not interchangeable, and how chasing 100% coverage on millions of lines of legacy code can be a waste everyone agrees to quietly. -
Agentic Systems in Testing: Why Humans Stay in the Loop - Nishan Portoyan 17.09.2026 28mWhat separates a handful of agents from a real agentic system? With Nishan Portoyan I talk about exactly that line, and why most teams are still on the wrong side of it. We walk through a full testing pipeline where eight to twelve agents handle everything from requirement review to performance test conversion, and I keep coming back to the question of where the human has to step in and why the AI simply cannot replace that judgment. Nishan is direct about what these systems cannot do: they do not think, they gather information and hand it back, and anyone expecting otherwise will run into tro... -
AI in Software Testing Raises the Value of Expert Testers - Olivier Denoo 10.09.2026 21mWhat happens to quality when anyone can generate code with a prompt but nobody checks whether it actually works? With Olivier Denoo I talk about why that question puts expert testers in a stronger position than many managers currently assume. We get into the real risk of AI that always sounds right, the edge cases a lost suitcase in Brussels reveals, and why the hardest unsolved problem in testing is still the same one Olivier ran into three decades ago: describing precisely what you want. The skills I keep coming back to in this conversation are business understanding, communication, and the... -
Lean Management: Why Problem Analysis Beats Quick Fixes - Nirmala Saneechur 03.09.2026 21mWhy do we rush to fix problems before we actually understand them? With Nirmala Saneechur I talk about Lean management, what it means to deliver quality at the right time rather than just on time, and why spending a full day understanding a problem is not wasted time. We get into what waste really means in a software project, including the story of 15 features a client never used, and how working in silos creates the kind of back-and-forth that slows everything down. -
Performance Monitoring: Set a 70% CPU Alert Before Failure - Rao Dhaligadoo 27.08.2026 17mSlow systems don't just annoy users, they cost companies real money, and most teams only find out when the phone starts ringing. With Rao Dhaligadoo I talk about what it actually takes to catch performance problems before customers do. We get into how a 70 percent CPU threshold can trigger an automated chain of monitoring, ticket creation, and root cause analysis, and why that matters more than it sounds. Rao also shares what it feels like to spend 45 hours in a war room at a bank, watching a CIO walk in at 1 a.m. while the whole team sits in silence, and how that experience shaped the way he... -
End-to-End Test Automation Without the Maintenance Trap - Lilia Gargouri 20.08.2026 33mForty percent of automation time lost to flakiness and maintenance: that is the reality Lilia Gargouri describes. I talked with Lilia about end-to-end test automation at scale, and what struck me most was how far back the real solutions reach: a single HTML attribute added in 2017 still pays dividends today, simply because the team decided to use it consistently and never change it. We get into the full picture, from how to accurately identify every UI element without XPath gymnastics, to why fifteen well-chosen test cases can outperform five hundred noisy ones, to naming conventions and layer... -
API Testing: Agent-Optimized Design Cuts Token Costs - Sebastian Małyska 13.08.2026 34mWith Sebastian Malyska I talk about what sits behind the APIs testers often take for granted. We get into why REST is still on top but not the whole story, how GraphQL and webhooks fit into the picture, and what actually happens when an AI agent talks to a real system through MCP. There is a practical argument running through all of it: if you understand the protocol layer, you can make smarter decisions about where to test, how to structure automation, and how to avoid burning unnecessary tokens and budget. Sebastian also makes the case that front-end testers are already closer to this world... -
LLMs in Software Testing: Start with Small, Bounded Tasks - Klaudia Dussa-Zieger 06.08.2026 26mWith Klaudia Dussa Zieger I talk about where language models actually deliver in testing and where they fall flat. We get into the concrete details: why a small function like generating keyword documentation works so well with a standard chat model, why reviews only started working once they switched to a reasoning model, and why one engineer working on embedded legacy code said no to AI help without hesitation. Klaudia also shares the translation use case I found most vivid, turning a cryptic technical defect message into something a domain tester can actually read. -
Testing Complex Systems: Ship Small and Learn Fast - Jean Francois Riverin 30.07.2026 20mWith Jean-Francois Riverin I get into a question that bothered him for over 20 years: why are there still bugs in production even when you tested as well as you possibly could? His answer is that software stopped being a complicated problem, like building a bridge, a long time ago. It is now complex, more like medicine or meteorology, and that means the whole idea of finding the right answer through testing is the wrong goal. We talk about what it looks like to switch that mindset, what "safe to fail" means in practice, and how to make that argument to a manager who still expects predictable b... -
Holistic Engineering: Non-Technical Forces Shape Your Code - Vanessa Formicola 23.07.2026 25mWhy do so many software teams end up with the exact architecture they never intended to build? With Vanessa Formicola I talk about the hidden forces that shape technical decisions, and why those forces have far less to do with technology than most engineers want to admit. We get into patterns she calls the kitchen sink, Cirque de Soleil coding, and the monolith constellation, each one a recognizable trap that grows from career incentives, delivery pressure, and organizational culture rather than bad technical judgment. I keep coming back to her concept of holistic engineering, which asks us to... -
Children's Book About Testing That Inspired a Future Tester - Kari Kakkonen 16.07.2026 16mWith Kari Kakkonen I talk about what happens when you explain software testing through a fantasy story for children, where dragons are defects and knights are testers. We get into how the analogy grew into a full world covering functional, performance, usability, and security defects, each mapped to a chapter with its own kind of dragon. Kari describes how he tested the book iteratively with children, teachers, testing professionals, and non-IT readers across four rounds, and how a twelve-year-old at a book fair said she wanted testing as a profession after flipping through it. We also touch o... -
TMMI Level 5: How Mature Teams Stop Bugs Before They Exist - Zsolt Hargitai 09.07.2026 16mWhat does it actually take to move from finding defects to preventing them? With Zsolt Hargitai I talk about TMMI, a framework for improving test processes, and why that shift in mindset marks the difference between a team that tests and a team that has genuinely matured. We get into what the maturity levels mean in practice, how a free self-assessment tool on the TMMI website gives you a first impression of where your organization stands, and why the framework holds up across agile, V-model, and DevOps environments alike. I was also curious about the human side: Zsolt mentions that companies...
Popular in
The podcast also appears in the podcast charts of these countries.