Fatalities Reportedly Occur Despite VioGén Algorithm's Low or Negligible Risk Scores
Description
The VioGén algorithm was designed to help Spanish police assess and prioritize the risk of repeat domestic violence incidents. However, its low-risk assessment of Lobna Hemid reportedly led to inadequate protection; her husband murdered her. Since 2007, 247 women have been killed after being assessed by VioGén. A review of 98 homicides found that 55 of the slain women were scored as negligible or low risk.
Actors
Alleged Deployers
- spanish-law-enforcement-agencies
- spanish-interior-ministry
- government-of-spain
- law-enforcement
Alleged Developers
- viogen-algorithm-development-team
- spanish-law-enforcement-agencies
- spanish-interior-ministry
- government-of-spain
Harmed Parties
- women-and-girls
- women
- victims-of-domestic-abuse
- stefany-gonzalez-escarraman
- maria
- luz
- lobna-hemid
- general-public-of-spain
- general-public
- eva-jaular
- 247-women-in-spain-(unnamed)
Classification
Risk Domain
AI Safety & FailuresRisk Subdomain
7.3. Lack of capability or robustness
MIT Risk Profile
Topics
Source
Related Incidents (AI Safety & Failures)
View all →Research Papers on This Topic
View all →Concrete Problems in AI Safety
A Survey on Explainable Artificial Intelligence (XAI): Towards Medical XAI
Representation Engineering: A Top-Down Approach to AI Transparency
Explainable artificial intelligence (XAI) in deep learning-based medical image analysis
Mitigation Tools
Tools related to this risk domain, via shared responsible AI topics.