“Will AI replace testers?” is the wrong question.

Dec 17, 2025

Create Memory
Infographic titled “AI in Testing: The 6 Traps Vendors Don’t Mention”. It lists six risks with icons: the high environmental cost of running AI models due to energy use and carbon footprint; the risk of de-skilling teams through over-reliance on AI; a legal liability black hole when autonomous AI causes damage; an “AI winter” performance plateau where reliability never reaches mission-critical levels; “AI janitor” burnout from repeatedly checking AI output instead of doing creative testing work; and vendor lock-in when fine-tuned models and data cannot be taken elsewhere.

Most conversations about AI in testing are still stuck on the same question:
“Will AI replace testers?”

Meanwhile, the real risks are hiding in plain sight.

Vendors rarely talk about the deeper traps teams fall into when they adopt AI without a strategy. Things like the slow erosion of engineering skill, the legal gaps nobody wants to own, or the burnout that comes from turning testers into human janitors for AI output.

These issues are far more important than whether a model can generate a test case.

I put together an infographic with six traps I see teams run into when AI is introduced without guardrails or clear quality outcomes. None of these are reasons to avoid AI, but they are reasons to adopt it thoughtfully.

If you want AI to actually improve quality, not just create new types of waste and risk, you need to understand the trade offs before you press go.

Curious to explore this more? I’m posting more practical guidance on AI in testing over the next few weeks, including how to evaluate AI tools without falling for vendor theatre.

Kat Obring
Founder, Director
she/her
Former chef turned software testing expert Kat Obring brings 20 years of experience from Disney, Anaplan, and Accenture. She offers quality leadership coaching and training courses.
Sign in to comment
Explore MoT
RBCN 2026 image
Tue, 10 Feb
Where the Robot Framework community shines brightest.
Prompting for Testers image
Unleash the power of generative AI to boost your software testing and day-to-day tech tasks
This Week in Quality image
Debrief the week in Quality via a community radio show hosted by Simon Tomes and members of the community
Subscribe to our newsletter
We'll keep you up to date on all the testing trends.