Incident #295·AI Safety & Failures
Wrongful Attempted Arrest for Apple Store Thefts Due to NYPD’s Facial Misidentification
Explainability
Description
New York Police Department (NYPD)’s facial recognition system falsely connected a Black teenager to a series of thefts at Apple stores, which resulted in his wrongful attempted arrest.
Actors
Alleged Deployers
- new-york-police-department
Alleged Developers
- unknown
Harmed Parties
- ousmane-bah
- nyc-black-young-people
- nyc-black-people
Classification
Risk Domain
AI Safety & FailuresRisk Subdomain
7.3. Lack of capability or robustness
MIT Risk Profile
AIUnintentionalPost-deployment
Topics
Explainability
Source
Related Incidents (AI Safety & Failures)
View all →Research Papers on This Topic
View all →Concrete Problems in AI Safety
3,612 citationsJun 2016
A Survey on Explainable Artificial Intelligence (XAI): Towards Medical XAI
2,338 citationsJul 2019
Representation Engineering: A Top-Down Approach to AI Transparency
1,499 citationsOct 2023
Explainable artificial intelligence (XAI) in deep learning-based medical image analysis
1,178 citationsJul 2021
Mitigation Tools
Tools related to this risk domain, via shared responsible AI topics.