AI red teaming is an adversarial security testing methodology in which security and AI specialists simulate realistic attacks against AI systems to identify exploitable weaknesses before malicious actors can take advantage of them.
It differs from traditional penetration testing in both target and technique. Where conventional testing focuses on networks, infrastructure, and deterministic application logic, AI red teaming evaluates how a model, application, and surrounding system respond to adversarial natural-language input, manipulated context, and autonomous decision-making.
AI red teaming complements traditional application, cloud, infrastructure, and penetration testing.