SafetySecurityTrustworthinesscs.CV
Empirical Evaluation of Physical Adversarial Patch Attacks Against Overhead Object Detection Models
Gavin S. Hartnett, Li Ang Zhang, Caolionn O'Connell, Andrew J. Lohn, Jair Aguirre
June 25, 2022
arXiv.org
7 citations
Key Takeaways
-
Physical adversarial attacks are harder to execute than laboratory conditions suggest. The researchers found that adversarial patches—printed images designed to fool AI vision systems—are "far more difficult to successfully implement" in real-world desert environments compared to controlled digital settings, suggesting previous research may have overestimated the practical threat.
-
Overhead imagery presents unique challenges for adversarial attacks. The study specifically tested patches against object detection models using aerial and satellite camera footage, a more realistic scenario for real-world deployment than ground-level cameras typically studied, and found these conditions made attacks substantially less effective.
-
Real-world threat from adversarial examples may be overstated. The authors conclude that "the real-world threat posed by adversarial examples may be overstated," indicating that concerns about AI systems being easily fooled by physical patches in practical applications warrant recalibration based on empirical evidence.
-
Environmental factors significantly impact AI vulnerability. The research demonstrates that conditions like viewing angle, distance, lighting, and environmental context—factors present in real deployments but absent in lab tests—substantially reduce the effectiveness of adversarial attacks, highlighting the importance of testing AI systems under realistic conditions.