Automation Bias

Automation Bias image
Automation bias is an error in judgement that comes from evaluating information coming from automated sources, as we tend to put a high degree of trust in them. This is becoming more problematic as the number of automated systems we rely on is only growing and we have a tendency to not notice errors in their output. Examples in software testing include:

  • Assuming the automated test pipeline passing means the software is without bugs (trusting the automated tests too much).
  • Putting a lot of effort into fixing flaky automation because automation bias leads you to believe they hold a high degree of value.
Accepting AI or automated output without independently evaluating correctness, including accepting wrong answers with increased confidence because the tool projected certainty.
Explore MoT
QA Leadership Summit - The AI-Native Edge: Leading the Future of QA image
QALS Summer 2026: a leadership summit to move beyond AI testing pilots and build production-ready, AI-first QA organizations - powered by the BrowserStack AI Test Platform and 25+ connected AI agents
MoT Software Testing Essentials Certificate image
Boost your career in software testing with the MoT Software Testing Essentials Certificate. Learn essential skills, from basic testing techniques to advanced risk analysis, crafted by industry experts.
Into The Motaverse image
Into the MoTaverse is a podcast by Ministry of Testing, hosted by Rosie Sherry, exploring the people, insights, and systems shaping quality in modern software teams.
Subscribe to our newsletter