Advanced prompting for testers
Advanced prompting skills to turn AI into your trusted testing companion.
-
-
- Advanced
- 11
- 11
- 11
5 already enrolled
The prompting loop begins (& ends) with you
- Identify the key steps a tester performs in a prompting loop.
- Recognize the importance of human involvement in guiding AI to produce meaningful results.
- Evaluate AI outputs to identify if the issue was with the prompt, tool limitations, or testing context.
Tokens 101: What they are and why they matter
- Define what a token is in the context of large language models (LLMs).
- Explain how text is broken into tokens by LLMs.
- Apply token-awareness to craft concise and effective prompts that improve the accuracy and efficiency of AI-generated outputs.
Prompting tactics: Saving tokens, time, and trouble
- Identify common inefficiencies in prompting
- Distinguish between helpful and misleading prompt completions.
- Analyze your prompting choices based on the nature of the test task or question.
Council of LLMs for testers
- Understand the differences in strengths, perspectives, and outputs of various LLMs (e.g., ChatGPT, Gemini, Claude).
- Apply the Council of LLMs method to a real or simulated testing challenge or work task.
- Compare and contrast the LLM outputs to identify overlaps, contradictions, or gaps.
How testers can use memory features in LLMs
- Identify the types of data that can be stored in LLM memory
- Use memory settings in LLM tools to store and retrieve relevant context or preferences.
- Design prompts that effectively leverage short-term and long-term memory features to maintain context across complex test scenarios or tasks.
Beyond text: Multi-modal prompting for testing
- Understand the role of newer modalities, such as image and video, in enhancing LLM capabilities.
- Evaluate the effectiveness of multi-modal prompts in reducing your effort and improving engagement.
Building custom test assistants (Custom GPTs)
- Understand the Concept of Custom GPTs
- Design Custom GPTs for regular testing tasks
Cutting through AI confusion: Reducing hallucinations
- Understand the reason behind confident AI hallucinations
- Design prompts that reduce hallucinations for testing tasks
Understanding RLHF: How human feedback influences AI
- Understand the role of RLHF in unverifiable domains and complex testing problems
- Compare and contrast data-dependent problems with people (or opinion) dependent problems.
Prompting Playgrounds: Prompt play in action
- Identify key components of AI prompt playgrounds (eg. Google AI Studio)
- Using studio settings to refine prompts for specific test objectives
Bringing everything together: Your advanced prompting project
- Summarize the learnings from this course.
- Reflect on the key areas to implement advanced prompting concepts and be a prompting ninja.
- Build your own AI testing assistant.
Go beyond the basics and unlock the full potential of AI in testing.
This course teaches you advanced prompting skills to turn AI into your trusted testing companion.
You’ll discover how to:
- Build reusable prompt templates and assistants
- Configure and use memory, multimodal inputs, and custom GPTs effectively.
- Reduce hallucinations and boost AI reliability.
- Design smarter prompts tailored to your real testing challenges
- Use AI as a council of thinking partners and brainstorming assistants.
If you’ve already mastered prompting fundamentals, this is the step that takes your AI-assisted testing to the next level.
No prior experience with advanced prompting is required. You’ll just need:
- Basic experience in software quality, testing, or development
- Completion of the Prompting for Testers course (or equivalent knowledge)
- Access to free-tier GenAI tools such as ChatGPT, Copilot, Gemini, or Claude
On the 1st & 2nd of October 2025 we're back in Brighton for TestBash: the largest software testing conference in the UK
Explore MoT
Wed, 17 Sep
with Ivan Fillipov, Solution Architect at Xray
Unleash the power of generative AI to boost your software testing and day-to-day tech tasks
A one-day educational experience to help business lead with expanding quality engineering and testing practices.
Debrief the week in Testing via a community radio show hosted by Simon Tomes and members of the community
Rahul Parwal is a Test Specialist with expertise in testing, automation, and AI in testing. He’s an award-winning tester, and international speaker.
Want to know more, Check out testingtitbits.com
