AI Incidents
Real-world cases where AI systems caused harm, classified by risk domain and entity. Data sourced from
AIID and classified by MIT AI Risk Initiative. CC BY-SA 4.0
112 incidents
Facebook's Friend Suggestion Feature Recommends Patients of Psychiatrist to Each Other
Facebook's "People You May Know" (PYMK) feature was reported by a psychiatrist for recommending her patients as friends through recommendations, violating patients' privacy and confidentiality.
Facebook's 'Tag Suggestions' Allegedly Stored Biometric Data without User Consent
Facebook's initial version of the its Tag Suggestions feature where users were offered suggestions about the identity of people's faces in photos allegedly stored biometric data without consent, violating the Illinois Biometric Information Privacy Act.
Google's Face Grouping Allegedly Collected and Analyzed Users' Facial Structure without Consent, Violated BIPA
A class-action lawsuit alleged Google failing to provide notice, obtain informed written consent, or publish data retention policies about the collection, storage, and analysis of its face-grouping feature in Google Photos, which violated Illinois Biometric Information Privacy Act (BIPA).
Oracle's Algorithmic Data Processing System Alleged as Unlawful and Violating Privacy Rights
Oracle's automated system involving algorithmic data processing was alleged in a lawsuit to have been unlawfully collecting personal data from millions of people and violating their privacy rights.
Facial Recognition Researchers Allegedly Used YouTube Videos of Transgender People Without Consent
YouTube videos of transgender people used by researchers to study facial recognition during gender transitions were allegedly used and distributed without permission.
Machine Personal Assistants Failed to Maintain Social Norms
During an experiment of software personal assistants at the Information Sciences Institute (ISI) at the University of Southern California (USC), researchers found that the assistants violated the privacy of their principals and were unable to respect the social norms of the office.
Target Suggested Maternity-Related Advertisements to a Teenage Girl's Home, Allegedly Correctly Predicting Her Pregnancy via Algorithm
Target recommended maternity-related items to a family in Atlanta via ads, allegedly predicting their teenage daughter’s pregnancy before her father did, although critics have called into question the predictability of the algorithm and the authenticity of its claims.