Manual Regression Testing Manifesto - Brendan Connolly
In an agile world where having dedicated testers can be a controversial idea, manual testing can be a tough sell. Not all contexts have their regression testing automated, so what is a manual tester to do when it comes time to release? Your team starts asking about regression testing, what testing is required and asks for estimates and expects justifications for the time being spent. Intuition isn't the answer, retesting everything is not an option.
We need a set of core values to serve as a heuristic foundation for understanding and communicating about regression testing. Inspired by the agile manifesto I'll identify 5 core values that testers can use to focus their regression testing efforts:
- Consistency Over Correctness
- Behaviors Over Bugs
- Intent over Implementation
- Conformity over Complexity
- Common over Complete
These values will define a clear intent and context for regression tests. This clarity will allow testers to easily identify and express their goals and intentions when performing regression tests and highlight its difference from feature testing.
This talk will provide a lens that testers can use to focus their regression testing into efficient and explainable actions and outcomes. Testers will be able to compare and contrast feature and regression testing.
The core values will help easily answer questions like
- What tests are you performing?
- How do you decide? Why?
Managers, developers, and other team members will get insight into the motivations a tester brings to regression testing. They will also get familiarity with actions and outcomes they expect to see from their testers during regression, leaving them better equipped to support their testers efforts.
The session will begin with a definition of regression.
Next, I will give a brief overview of the agile manifesto and the four values contained within it.
Then I will set a foundation for the need for a manual regression testing manifesto by highlighting:
- that the least experienced team members are tasked with regression testing
- the subtleties of testing and its phases are not always intuitively obvious to non-testers
- testers intentions and actions need to be transparent to be respected
I will then begin presenting the manual regression core values and for each of the 5 I will:
- define each term
- relate the definition to its role / impact on testing
- provide tangible steps or insights testers can utilize to frame their actions for communicating with their teams.
I'll wrap the session up with a call to action for testers to be more than just a mindset, to be true ambassadors of quality, through communication and skills.