“Will AI replace testers?” is the wrong question.

17 Dec 2025

Create Moment
Infographic titled “AI in Testing: The 6 Traps Vendors Don’t Mention”. It lists six risks with icons: the high environmental cost of running AI models due to energy use and carbon footprint; the risk of de-skilling teams through over-reliance on AI; a legal liability black hole when autonomous AI causes damage; an “AI winter” performance plateau where reliability never reaches mission-critical levels; “AI janitor” burnout from repeatedly checking AI output instead of doing creative testing work; and vendor lock-in when fine-tuned models and data cannot be taken elsewhere.
Most conversations about AI in testing are still stuck on the same question:
“Will AI replace testers?”

Meanwhile, the real risks are hiding in plain sight.

Vendors rarely talk about the deeper traps teams fall into when they adopt AI without a strategy. Things like the slow erosion of engineering skill, the legal gaps nobody wants to own, or the burnout that comes from turning testers into human janitors for AI output.

These issues are far more important than whether a model can generate a test case.

I put together an infographic with six traps I see teams run into when AI is introduced without guardrails or clear quality outcomes. None of these are reasons to avoid AI, but they are reasons to adopt it thoughtfully.

If you want AI to actually improve quality, not just create new types of waste and risk, you need to understand the trade offs before you press go.

Curious to explore this more? I’m posting more practical guidance on AI in testing over the next few weeks, including how to evaluate AI tools without falling for vendor theatre.
Kat Obring
Founder, Director
she/her

Kat Obring has spent 20+ years in software delivery: DevOps QA engineer, Head of Delivery, and now a quality coach who helps engineering teams build measurable improvement practices. She runs Kato Coaching Ltd and has presented at PeersCon, Agile Testing Days, HUSTEF, and TestBash, among others. She is direct, opinionated, and has strong feelings about the word "quality."

Sign in to comment
Explore MoT
Don’t automate everything, review everything image
Software Testing Live: Episode 06
Advanced prompting for testers image
Advanced prompting skills to turn AI into your trusted testing companion.
This Week in Quality image
Debrief the week in Quality via a community radio show hosted by Simon Tomes and members of the community
Subscribe to our newsletter
We'll keep you up to date on all the testing trends.