Qualitative Risk-Based Test Reporting - Nancy Kelln

Traditional quantitative software testing metrics can lie. They can give us a false sense of security and allow us to make bad decisions about our software under test. On software projects where the quality of the software built is high or when we have an infinite amount of time to test, we can survive the distraction of quantitative metrics. However, on a project where the quality of the software built is low or there are time pressures, reporting only quantitative metrics can cause more problems. If you have high risk systems, with lots of issues and little time to test, you need to consider Qualitative Risk-Based Test Reporting.

In this talk, Nancy Kelln will deliver our test reports from the evil lies quantitative metrics can tell, by introducing Risk-Based Qualitative methods for test documentation. Her approach has been successfully implemented on both large and small scale projects in various organizations. This approach can also be applied to Agile, Traditional and Exploratory Context-Driven test approaches.

Takeaways

Learning Objectives:

• Why making decisions with only quantitative metrics is dangerous.
• The power of qualitative metrics in testing.
• How to determine what qualitative metrics matter.
• How to incorporate qualitative metrics in your test reporting, including templates and examples.