Evolv AI Weapons Detection System Allegedly Misrepresents Accuracy, Leading to School Security Gaps
Description
Evolv's AI-powered weapons scanners were advertised as superior to metal detectors but reportedly failed to detect actual weapons while generating excessive false positives. The FTC alleged that misleading claims about the system's accuracy and speed contributed to schools relying on unreliable detection, with at least one incident in October 2022 involving a missed knife that resulted in a student being stabbed.
Actors
Alleged Deployers
- charlotte-mecklenburg-school-district
Alleged Developers
- evolv-technology
Harmed Parties
- teachers-at-charlotte-mecklenburg-schools
- students-at-charlotte-mecklenburg-schools
- students
- security-officers-at-charlotte-mecklenburg-schools
- school-administrators-at-charlotte-mecklenburg-schools
- parents-of-students-at-charlotte-mecklenburg-schools
- epistemic-integrity
- educational-communities
Classification
Risk Domain
AI Safety & FailuresRisk Subdomain
7.3. Lack of capability or robustness
MIT Risk Profile
Topics
Source
Related Incidents (AI Safety & Failures)
View all →Research Papers on This Topic
View all →Concrete Problems in AI Safety
A Survey on Explainable Artificial Intelligence (XAI): Towards Medical XAI
Representation Engineering: A Top-Down Approach to AI Transparency
Explainable artificial intelligence (XAI) in deep learning-based medical image analysis
Mitigation Tools
Tools related to this risk domain, via shared responsible AI topics.