Community Star

Bill Matthews has been a freelance test consultant for over 20 years working mainly on complex integration and migration as a Test Architect and as a Technical Lead. He champions the use of modern and effective approaches to development and testing.

He is a regular contributor to the testing community at both local and international levels through conference speaking, coaching/mentoring and delivering workshops and training focusing on automation, performance, reliability, security testing and more recently artificial intelligence.

May 2025
Spoke at a Ministry of Testing meetup
Ministry of Testing Coventry

Thursday, May 8, 2025

Bill Matthews
Owner & Consultant - Target Testing Ltd
Technical Lead - Voy Finance
Strategic Business Consultant

About the talk:
As Large Language Models (LLMs) become integral to modern applications, software testers must adapt their strategies to assess these AI-driven systems effectively. This talk explores the unique challenges of testing LLM-based applications, including their probabilistic nature, hallucinations, bias, and prompt sensitivity.

We will discuss key capabilities and risks that testers should focus on, methodologies for designing robust evaluation frameworks, and automation techniques to streamline testing. Attendees will also learn how to leverage LLMs as judges for qualitative assessments and explore tools that support scalable, systematic testing. Whether you're new to AI testing or looking to enhance your approach, this session will equip you with practical insights to ensure the reliability and fairness of LLM-based applications.

System
Expanded the MoTaverse
System
Expanded the MoTaverse
Subscribe to our newsletter
We'll keep you up to date on all the testing trends.