How does Data Poisoning Attacks work

Beginner

Answer

An attacker adds carefully crafted bad examples into the training data, hoping the model learns incorrect patterns that can later be exploited once the model is deployed.

Real-world example An attacker might poison a spam filter's training data so that certain harmful emails are incorrectly learned as safe.

Common follow-ups: What is AI Security & Adversarial Attacks, How is Data Poisoning Attacks evaluated in practice, What tools are commonly used for Data Poisoning Attacks

AI Security & Adversarial Attacks topics: Introduction to AI Security Adversarial Examples & Attacks Data Poisoning Attacks

All 7 Data Poisoning Attacks questions