Risks from Human Factors in Highly Automated Systems - Andrew Brown

  • Locked
Andrew's profile
Andrew

Risks from Human Factors in Highly Automated Systems - Andrew Brown image
Talk Description

As software development becomes increasingly automated, and as software becomes increasingly interconnected through the Internet of Things, what will happen to risks associated with human factors? Do they reduce, increase, or transform in ways that we can neither anticipate nor easily comprehend?

We examine the tragic events of flight AF477 to illustrate that as systems become increasingly automated, they reduce risks due to one set of human factors, but become vulnerable to an entirely different set of human factors. We show how increased automation of tasks leads to a significant reduction in numerous small errors, but this is coupled with an increased opportunity for creating a catastrophic error.

This increased opportunity for catastrophe typically comes via two routes. Firstly, there is an increase in operator load extremities, with decreased load during normal conditions, but increased load at times of crisis. Secondly, there is a de-skilling of roles, which leads to three effects:

  • A reduction in calibre of people required, and hence selected or attracted, into the role.
  • Reduced opportunities to practice techniques, as practise itself becomes more dangerous
  • The role becomes a dulled task, with employees often filling their time with non-work activities, such as Internet and mobile surfing, rather than honing job skills.

We use lessons and parallels from aviation and nuclear power generation to explore the implications of increased automation through DevOps driven software development, as well as investigating potential mitigation strategies available.

Takeaways

  1. As systems become more automated, there is a significant reduction in small errors.
  2. However, there is an increased opportunity for a catastrophic error.
  3. We should learn from industries, such as aviation and medicine, that have previously wrestled with this issue.
What you’ll learn

By the end of this talk, you'll be able to:

  • TBA
Andrew's profile'

Andrew

Dr Andrew Brown is a principal consultant at SQS. Recently, he has developed an independent line of research into understanding why we humans make the mistakes that lead to software defects and other problems in the software lifecycle. He has 25 years’ experience in the software industry. Previous roles include Head of QA at HMV, Head of QA at a financial software house and a test manager in Japan. He holds a degree in Physics and Maths, an MBA from Warwick Business School and a doctorate from Imperial College.
Suggested Content
Making The Most Of Your Python Script: Update, Reuse And Maintain
The Role of an Automator with Manuel Fidalgo Sicilia
Transcending The Tools
How to Identify Risk in a Large Code Base
I'm Hunting Sasquatch: Finding Intermittent Issues Using Periodic Automation - Paul Grizzaffi
Accessibility Testing Crash Course - James Sheasby Thomas
Explore MoT
Episode One: The Companion
A free monthly virtual software testing community gathering
MoT Foundation Certificate in Test Automation
Unlock the essential skills to transition into Test Automation through interactive, community-driven learning, backed by industry expertise

Tags

  • automation
  • risks