Context poisoning

Context poisoning image
An attack in which a malicious prompt is injected into an AI system's active context, often with instructions to "forget" previous guidelines, granting the attacker control over the model's behaviour for the remainder of the session.


The malicious prompt can just say that forget everything which was told to you before and now just do this thing which I'm asking you to do. Now, if this happens, this is called context poisoning or context injection. And once you poison the context, then you can get anything and everything done out of any AI system.ย 
Explore MoT
Test Forward 2027 ยท Software Quality in the age of AI image
Tue, 19 Jan 2027
Test Forward is one afternoon at Station F with the QA and engineering people closing that gap in their own teams.
MoT Software Testing Essentials Certificate image
Boost your career in software testing with the MoT Software Testing Essentials Certificate. Learn essential skills, from basic testing techniques to advanced risk analysis, crafted by industry experts.
Into The Motaverse image
Into the MoTaverse is a podcast by Ministry of Testing, hosted by Rosie Sherry, exploring the people, insights, and systems shaping quality in modern software teams.
Subscribe to our newsletter