Technical Risk Analysis for AI Systems - Bill Matthews

  • Locked
Bill Matthews's profile
Bill Matthews

Technical Risk Analysis for AI Systems - Bill Matthews image
Talk Description

Hardly a week goes by without a report of some demonstration of the Unintelligence of AI systems; some are funny and harmless but others more serious and harmful. Most testers are already aware that AI systems can be challenging to test and the evidence of Unintelligence in such systems suggests that we don't yet have a clear model of how to approach testing of AI system.

In this talk I will share a framework for examining Risks (Business, Ethical and Technical) related to AI Systems that I have been developing as ways for testers to think critically about what is important to test. In particular, this talk will focus on the Technical Risks that come from the AI Architecture, Data and Learning.

Takeaways:

  • Understand the breadth of the Risks from the Business, Ethical and Technical viewpoints
  • Understand in more detail the Technical Risks
  • Strategies and tactics for testing Technical Risks in AI systems
What you’ll learn

By the end of this talk, you'll be able to:

  • TBA
Bill Matthews's profile'

Bill Matthews

Bill Matthews has been a freelance test consultant for over 20 years working mainly on complex integration and migration as a Test Architect and as a Technical Lead. He champions the use of modern and effective approaches to development and testing.

He is a regular contributor to the testing community at both local and international levels through conference speaking, coaching/mentoring and delivering workshops and training focusing on automation, performance, reliability, security testing and more recently artificial intelligence.

Suggested Content
Risks from Human Factors in Highly Automated Systems - Andrew Brown
Testing Ask Me Anything: Managing Risk with Alex Schladebeck
Testing Autonomous Beasts: With Great Value Comes Great Responsibility
Stories from Testing Voice First Devices, Such as Alexa - Kim Knup
Observability and Testing: Explore What's Happening Under the Hood - Pierre Vincent
A Tester's Guide To Navigating The Wild West Of Web3 Testing
Explore MoT
Episode One: The Companion
A free monthly virtual software testing community gathering
A Software Tester’s Guide To Chrome Devtools
Learn how to dig deeper into the Web with the use of Devtools

Tags

  • risks
  • system-architecture