Activity

Bill Matthews has been a freelance test consultant for over 20 years working mainly on complex integration and migration as a Test Architect and as a Technical Lead. He champions the use of modern and effective approaches to development and testing.

He is a regular contributor to the testing community at both local and international levels through conference speaking, coaching/mentoring and delivering workshops and training focusing on automation, performance, reliability, security testing and more recently artificial intelligence.

Bill Matthews
Bill Matthews
achieved:
This badge is awarded to members who update their profile with a new photo. image
This badge is awarded to members who update their profile with a new photo.
Bill Matthews
Bill Matthews
achieved:
This badge is awarded to members who visit the Ministry of Testing site 99 times image
This badge is awarded to members who visit the Ministry of Testing site 99 times
Bill Matthews
Bill Matthews
achieved:
This badge is awarded to members who update their social links on their profile. image
This badge is awarded to members who update their social links on their profile.
Bill Matthews
Bill Matthews
achieved:
This badge is awarded to members who publish their first article on the Ministry of Testing site image
This badge is awarded to members who publish their first article on the Ministry of Testing site
Bill Matthews
Bill Matthews
achieved:
Earned through actions that have made the MoT Community a more pleasant and useful place to be. image
Earned through actions that have made the MoT Community a more pleasant and useful place to be.
<div>Featured your podcast on the homepage.</div> image
Featured your podcast on the homepage.
Bill Matthews
Bill Matthews
contributed:
A dive into the evolving landscape of AI testing, discussing the challenges testers face with generative AI and machine learning systems. image
A dive into the evolving landscape of AI testing, discussing the challenges testers face with generative AI and machine learning systems.
<a href="https://www.ministryoftesting.com/testbash-sessions/responsible-ai-opportunities-and-challenges-for-testers" rel="noopener nofollow">Responsible AI: Opportunities and Challenges for Testers</a> image
Responsible AI: Opportunities and Challenges for Testers
<a href="https://www.ministryoftesting.com/the-testing-planet-sessions/a-cosmic-conversation-about-the-evolution-of-ai" rel="noopener nofollow">A Cosmic Conversation About the Evolution of AI</a> image
A Cosmic Conversation About the Evolution of AI
<a href="https://www.ministryoftesting.com/testbash-sessions/technical-risk-analysis-for-ai-systems-bill-matthews" rel="noopener nofollow">Technical Risk Analysis for AI Systems - Bill Matthews</a> image
Technical Risk Analysis for AI Systems - Bill Matthews
<a href="https://www.ministryoftesting.com/testbash-sessions/context-driven-security-bill-matthews" rel="noopener nofollow">Context Driven Security - Bill Matthews</a> image
Context Driven Security - Bill Matthews
<a href="https://www.ministryoftesting.com/testbash-sessions/get-out-of-the-testing-game-bill-matthews" rel="noopener nofollow">Get Out Of The Testing Game - Bill Matthews</a> image
Get Out Of The Testing Game - Bill Matthews
<a href="https://www.ministryoftesting.com/testbash-sessions/smart-algorithms-are-we-ready-for-this-bill-matthews" rel="noopener nofollow">Smart Algorithms – Are We Ready For This? – Bill Matthews</a> image
Smart Algorithms – Are We Ready For This? – Bill Matthews
<a href="https://www.ministryoftesting.com/memories/great-talk-by-bill-matthews" rel="noopener nofollow">Great talk by Bill Matthews</a> image
Great talk by Bill Matthews
<a href="https://www.ministryoftesting.com/memories/mot-coventry-meetup-may-2025" rel="noopener nofollow">MoT Coventry Meetup - May 2025</a> image
MoT Coventry Meetup - May 2025
Bill Matthews
Bill Matthews
contributed:
Bill Matthews is giving a fantastic talk on testing LLM-based applications. image
Bill Matthews is giving a fantastic talk on testing LLM-based applications.
<div>Ministry of Testing Coventry<br><br>Thursday, May 8, 2025<br><br><strong><em>Bill Matthews</em></strong><br>• <em>Owner &amp; Consultant</em> - Target Testing Ltd<br>• <em>Technical Lead</em> - Voy Finance<br>• <em>Strategic Business Consultant<br></em><br>
</div><div>
<strong>About the talk:</strong><br>As Large Language Models (LLMs) become integral to modern applications, software testers must adapt their strategies to assess these AI-driven systems effectively. This talk explores the unique challenges of testing LLM-based applications, including their probabilistic nature, hallucinations, bias, and prompt sensitivity.<br><br>
</div><div>We will discuss key capabilities and risks that testers should focus on, methodologies for designing robust evaluation frameworks, and automation techniques to streamline testing. Attendees will also learn how to leverage LLMs as judges for qualitative assessments and explore tools that support scalable, systematic testing. Whether you're new to AI testing or looking to enhance your approach, this session will equip you with practical insights to ensure the reliability and fairness of LLM-based applications.<br><br>
</div> image
Ministry of Testing CoventryThursday, May 8, 2025Bill Matthews• Owner & Consultant - Target Testing Ltd• Technical Lead - Voy Finance• Strategic Business Consultant About the talk:As Large Language Models (LLMs) become integral to modern applications, software testers must adapt their strategies to assess these AI-driven systems effectively. This talk explores the unique challenges of testing LLM-based applications, including their probabilistic nature, hallucinations, bias, and prompt sensitivity. We will discuss key capabilities and risks that testers should focus on, methodologies for designing robust evaluation frameworks, and automation techniques to streamline testing. Attendees will also learn how to leverage LLMs as judges for qualitative assessments and explore tools that support scalable, systematic testing. Whether you're new to AI testing or looking to enhance your approach, this session will equip you with practical insights to ensure the reliability and fairness of LLM-based applications.
Bill Matthews
Bill Matthews
contributed:
A great talk by Bill Matthews for us here at Coventry at Sainsburys Store Support Centre image
A great talk by Bill Matthews for us here at Coventry at Sainsburys Store Support Centre
Bill Matthews
Bill Matthews
achieved:
This badge is awarded to members who confirm their tickets to TestBash Brighton 2024 image
This badge is awarded to members who confirm their tickets to TestBash Brighton 2024
Bill Matthews
Bill Matthews
achieved:
This badge is awarded to a member who has spoken at a TestBash conference. image
This badge is awarded to a member who has spoken at a TestBash conference.
Bill Matthews
Bill Matthews
achieved:
This badge is awarded to those who contribute to any Testing Planet episodes. image
This badge is awarded to those who contribute to any Testing Planet episodes.
Bill Matthews
Bill Matthews
achieved:
This badge is awarded to those who donate to the MoT Scholarship Fund image
This badge is awarded to those who donate to the MoT Scholarship Fund
Bill Matthews
Bill Matthews
achieved:
This badge is awarded to members who have attended a TestBash event. image
This badge is awarded to members who have attended a TestBash event.
Bill Matthews
Bill Matthews
contributed:
This talk unpacks the essence of Responsible AI image
This talk unpacks the essence of Responsible AI
Bill Matthews
Bill Matthews
achieved:
This badge is awarded to members who have subscribed as Professional Members. image
This badge is awarded to members who have subscribed as Professional Members.
Bill Matthews
Bill Matthews
contributed:
Uncover the potential of AI in testing through simple, short daily tasks image
Uncover the potential of AI in testing through simple, short daily tasks
Bill Matthews
Bill Matthews
contributed:
Explore the ethical concerns, valid applications, challenges and future prospects of AI integration in testing toolkits. image
Explore the ethical concerns, valid applications, challenges and future prospects of AI integration in testing toolkits.
Bill Matthews
Bill Matthews
achieved:
This badge is awarded to members who have updated their profile. image
This badge is awarded to members who have updated their profile.
Bill Matthews
Bill Matthews
achieved:
This badge is awarded to members who have signed up as a Club member. image
This badge is awarded to members who have signed up as a Club member.
Bill Matthews
Bill Matthews
contributed:
Watch "Technical Risk Analysis for AI Systems" with Bill Matthews from Test.bash(); 2019 image
Watch "Technical Risk Analysis for AI Systems" with Bill Matthews from Test.bash(); 2019
Bill Matthews
Bill Matthews
contributed:
Explore strategies to tackle testing AI-based apps image
Explore strategies to tackle testing AI-based apps
Bill Matthews
Bill Matthews
contributed:
Bill Matthews
Bill Matthews
contributed:
Watch "Context Driven Security" with Bill Matthews from TestBash Brighton 2013 image
Watch "Context Driven Security" with Bill Matthews from TestBash Brighton 2013
Subscribe to our newsletter
We'll keep you up to date on all the testing trends.