Incident #186·AI Safety & Failures
Algorithm Assessing Risk Faced by Victims of Gender Violence Misclassified Low-Risk Cases, Allegedly Leading to Homicide of Women and Children in Spain
Explainability
Description
In Spain, the algorithm that assesses recidivism risk in gender violence, VioGén, has allegedly critically underestimated the level of risk in a series of cases that ended in homicide of women and children since its first deployment.
Actors
Alleged Deployers
- spanish-ministry-of-interior
- government-of-spain
Alleged Developers
- spanish-secretary-of-state-for-security
- spanish-ministry-of-interior
- government-of-spain
Harmed Parties
- women
- victims-of-gender-violence-in-spain
- victims-of-gender-violence
- victims-of-domestic-abuse
- minors
- general-public-of-spain
- general-public
- women-and-girls
Classification
Risk Domain
AI Safety & FailuresRisk Subdomain
7.3. Lack of capability or robustness
MIT Risk Profile
AIUnintentionalPost-deployment
Topics
Explainability
Source
Related Incidents (AI Safety & Failures)
View all →Research Papers on This Topic
View all →Concrete Problems in AI Safety
3,612 citationsJun 2016
A Survey on Explainable Artificial Intelligence (XAI): Towards Medical XAI
2,338 citationsJul 2019
Representation Engineering: A Top-Down Approach to AI Transparency
1,499 citationsOct 2023
Explainable artificial intelligence (XAI) in deep learning-based medical image analysis
1,178 citationsJul 2021
Mitigation Tools
Tools related to this risk domain, via shared responsible AI topics.