Beyond Creation: Leveraging AI in Test Automation to Solve the Right Problems

1st October 2024
  • Locked
Titus Fortner's profile
Titus Fortner

Sr Developer Advocate

Beyond Creation: Leveraging AI in Test Automation to Solve the Right Problems image
Talk Description

Successful test automation implementations are notoriously difficult, and likely even the majority of teams are not getting the minimum necessary value from their efforts. Companies are increasingly turning to Artificial Intelligence (AI) as the answer, but so far the focus has been on making it easier to create the tests themselves. This can be useful, but it does not address the actual bottleneck: the requirement to maintain accurate test results over time. We need to focus on how AI can help testers rather than replace them.

In this talk, Titus will discuss the limitations of AI in its current form, and highlight data from multiple studies and surveys relating to how developers are actively using Large Language Models (LLMs) to identify their strengths and weaknesses. It is commonly known that LLMs hallucinate, so, similar to how testers are responsible for verifying the quality of the application they are testing, testers also need to verify the quality of the AI output in their workflows.

This talk will use the Selenium repository as an example to show how ChatGPT was used to automate the complicated Selenium build and release process. It will show how LLM tooling can provide value for both code generation and code management.

The bottom line — to harness the full potential of AI in test automation, we must shift our focus from generating tests to empowering testers. By doing so, we can address the real problems facing test automation today, ensuring more sustainable and effective outcomes.

By the end of this session, you'll be able to:

  • Understanding the limitations of current AI implementations in test automation and the need to shift focus towards empowering testers
  • Exploring the role of Large Language Models (LLMs) in identifying strengths and weaknesses in test automation processes
  • Learning how AI, particularly LLMs, can be leveraged for both code generation and code management in test automation workflows, using the Selenium repository as a case study
Sr Developer Advocate
I'm an open source software developer and a core contributor to automated testing projects including Selenium and Watir. I implemented automated testing solutions at several companies before joining Sauce Labs as a Solutions Architect, where I worked extensively with clients to improve their testing code and strategies. Currently a Senior Developer Advocate at Sauce Labs, I'm passionate about building communities and improving the software industry’s understanding of how to successfully conduct testing at scale and provide digital confidence.
Suggested Content
The membership for software testing professionals image
Join thousands of other software testers in levelling up their careers
Explore MoT
Episode Eight: Exploring Quality Engineering image
Land on the quality engineering planet!
MoT Foundation Certificate in Test Automation
Unlock the essential skills to transition into Test Automation through interactive, community-driven learning, backed by industry expertise
This Week in Testing
Debrief the week in Testing via a community radio show hosted by Simon Tomes and members of the community
Subscribe to our newsletter
We'll keep you up to date on all the testing trends.