Automation bias is an error in judgement that comes from evaluating information coming from automated sources, as we tend to put a high degree of trust in them. This is becoming more problematic as the number of automated systems we rely on is only growing and we have a tendency to not notice errors in their output. Examples in software testing include:
- Assuming the automated test pipeline passing means the software is without bugs (trusting the automated tests too much).
- Putting a lot of effort into fixing flaky automation because automation bias leads you to believe they hold a high degree of value.