NYPD Facial Recognition System Allegedly Produced Erroneous Match That Reportedly Resulted in Wrongful Detention of Trevis Williams
Description
The NYPD's facial recognition system allegedly misidentified Trevis Williams as a suspect in a Union Square indecent exposure case. Despite reportedly notable physical differences and exculpatory phone data, Williams was arrested, jailed for more than two days, and charged. The case was later dismissed.
Actors
Alleged Deployers
- nypd
- new-york-police-department
- law-enforcement
- facial-recognition-system-deployers
Alleged Developers
- facial-recognition-system-developers
Harmed Parties
- trevis-williams
- law-enforcement
- judicial-integrity
- general-public-of-new-york
- general-public
Classification
Risk Domain
AI Safety & FailuresRisk Subdomain
7.3. Lack of capability or robustness
MIT Risk Profile
Topics
Source
Related Incidents (AI Safety & Failures)
View all →Research Papers on This Topic
View all →Concrete Problems in AI Safety
A Survey on Explainable Artificial Intelligence (XAI): Towards Medical XAI
Representation Engineering: A Top-Down Approach to AI Transparency
Explainable artificial intelligence (XAI) in deep learning-based medical image analysis
Mitigation Tools
Tools related to this risk domain, via shared responsible AI topics.