I'm Hunting Sasquatch:  Finding Intermittent Issues Using Periodic Automation - Paul Grizzaffi image

I'm Hunting Sasquatch: Finding Intermittent Issues Using Periodic Automation - Paul Grizzaffi

  • Locked
Paul Grizzaffi's profile
Paul Grizzaffi

Principal Automation Architect

Talk Description

In American pop culture, Sasquatch (also known as Bigfoot) is likely a non-existent, ape-like, creature infrequently seen in the Pacific Northwest of North America. In the software realm, we have our own version of Sasquatch: that irritating, "intermittent issue" occurring in the system. These kinds of issues are typically difficult to find and often blamed on anything other than a product defect.

We typically run our automated tests on event boundaries, i.e. when we have a successful build and deployment; we look for problems when we think we may have introduced problems. Logically, these points of change are when we expect to have injected new issues, so, we only look for issues at those times. This approach alone, however, only gives us limited opportunities to reproduce our intermittent issues. If we also ran our automation periodically, we would have additional opportunities to reproduce these types of issues; we simply call this approach periodic automation.

Using a real-world example from his own experience, Paul Grizzaffi will explain how this periodic automation can help hunt down these elusive targets. For additional context, he will explain how this approach relates to High-Volume Automated Testing (HiVAT), as well as some HiVAT basics and examples. He will also explore some considerations of which we need to be mindful when implementing periodic automation in order to avoid desensitisation to failures.

Though we may never find “the real” Sasquatch, applying periodic automation increases our chances of finding our own intermittent issues.

Takeaways

  • The complexity of most current software systems all but guarantees intermittent issues.
  • Running automation on non-event boundaries can help catch intermittent issues.
  • While periodic automation evolved from academic-research, it also has real-world applications.
  • We must be mindful of “failure fatigue” when adding automation runs

 

What you’ll learn
  • Describe continuous integration
  • Identify issues that can impact automated checks
  • Explain what race conditions in applications are
  • Identify ways to use automation to address intermittent issues in a system
  • Describe what Hi Value Automated Tests are (HiVAT)
Paul Grizzaffi's profile'

Paul Grizzaffi

Principal Automation Architect

About Speaker

As a Principal Automation Architect at Magenic, Paul Grizzaffi is following his passion of providing technology solutions to testing and QA organizations, including automation assessments, implementations, and through activities benefiting the broader testing community. An accomplished keynote speaker and writer, Paul has spoken at both local and national conferences and meetings. He is an advisor to Software Test Professionals and STPCon, as well as a member of the Industry Advisory Board of the Advanced Research Center for Software Testing and Quality Assurance (STQA) at UT Dallas where he is a frequent guest lecturer. Paul enjoys sharing his experiences and learning from other testing professionals; his mostly cogent thoughts can be read on his blog at https://responsibleautomation.wordpress.com/.

More Talks
QMetry Product Demo

0h 13m 56s

From SDET to SRE - Cristiano Cunha

0h 41m s

Autify - AI-powered Low-code Automation Testing Platform

0h 10m 40s

Revisited: The Tester’s Survival Guide to Joining a Continuous Delivery Project - Amy Phillips

1h 0m 32s

Building Customer Happiness with a Tiny Team - Paul Campbell

0h 30m 26s

Extra! Extra! Automation Declared Software! - Paul Grizzaffi

0h 40m 50s

Risk Based Testing Because You Can't Do EVERYTHING - Jenny Bramble

0h 26m 44s

Accessibility Testing Crash Course - James Sheasby Thomas

0h 24m 1s

Risks from Human Factors in Highly Automated Systems - Andrew Brown

0h 47m 53s

Extra! Extra! Automation Declared Software! - Paul Grizzaffi

0h 40m 50s

Stacking The Automation Deck - Paul Grizzafi

0h 31m 52s

Watch Party: TestBash Revisited with Paul Grizzafi

1h 1m 35s