Incident #29·AI Safety & Failures
Image Classification of Battle Tanks
Explainability
Description
A potentially apocryphal story in which an image classifier was produced to differentiate types of battle tanks, but the resulting model keyed in on environmental attributes rather than tank attributes
Actors
Alleged Deployers
- united-states-government
Alleged Developers
- united-states-government
Harmed Parties
- united-states-government
Classification
Risk Domain
AI Safety & FailuresRisk Subdomain
7.1. AI pursuing its own goals in conflict with human goals or values
MIT Risk Profile
AIUnintentionalPre-deployment
Topics
Explainability
Source
Related Incidents (AI Safety & Failures)
View all →Research Papers on This Topic
View all →Concrete Problems in AI Safety
3,612 citationsJun 2016
A Survey on Explainable Artificial Intelligence (XAI): Towards Medical XAI
2,338 citationsJul 2019
Representation Engineering: A Top-Down Approach to AI Transparency
1,499 citationsOct 2023
Explainable artificial intelligence (XAI) in deep learning-based medical image analysis
1,178 citationsJul 2021
Mitigation Tools
Tools related to this risk domain, via shared responsible AI topics.