Technical Risk Analysis for AI Systems - Bill Matthews

4th October 2019
  • Locked
Bill Matthews's profile
Bill Matthews

Technical Risk Analysis for AI Systems - Bill Matthews image
Talk Description

Hardly a week goes by without a report of some demonstration of the Unintelligence of AI systems; some are funny and harmless but others more serious and harmful. Most testers are already aware that AI systems can be challenging to test and the evidence of Unintelligence in such systems suggests that we don't yet have a clear model of how to approach testing of AI system.

In this talk I will share a framework for examining Risks (Business, Ethical and Technical) related to AI Systems that I have been developing as ways for testers to think critically about what is important to test. In particular, this talk will focus on the Technical Risks that come from the AI Architecture, Data and Learning.

Takeaways:

  • Understand the breadth of the Risks from the Business, Ethical and Technical viewpoints
  • Understand in more detail the Technical Risks
  • Strategies and tactics for testing Technical Risks in AI systems

By the end of this session, you'll be able to:

  • TBA

Bill Matthews has been a freelance test consultant for over 20 years working mainly on complex integration and migration as a Test Architect and as a Technical Lead. He champions the use of modern and effective approaches to development and testing.

He is a regular contributor to the testing community at both local and international levels through conference speaking, coaching/mentoring and delivering workshops and training focusing on automation, performance, reliability, security testing and more recently artificial intelligence.

Suggested Content
Qase — Automate manual tests in one click image
Orchestrate manual and automated testing with 35 integrations, AI test case generation, customizable reports and more.
Explore MoT
TestBash Brighton 2025 image
Wed, 1 Oct 2025
On the 1st & 2nd of October, 2025 we'll be back to Brighton for another TestBash: the largest software testing conference in the UK
A Software Tester’s Guide To Chrome Devtools
Learn how to dig deeper into the Web with the use of Devtools
This Week in Testing
Debrief the week in Testing via a community radio show hosted by Simon Tomes and members of the community
Subscribe to our newsletter
We'll keep you up to date on all the testing trends.