AI Incidents
Real-world cases where AI systems caused harm, classified by risk domain and entity. Data sourced from
AIID and classified by MIT AI Risk Initiative. CC BY-SA 4.0
49 incidents
Researchers' Homosexual-Men Detection Model Denounced as a Threat to LGBTQ People's Safety and Privacy
Researchers at Stanford Graduate School of Business developed a model that determined, on a binary scale, whether someone was homosexual using only his facial image, which advocacy groups such as GLAAD and the Human Rights Campaign denounced as flawed science and threatening to LGBTQ folks.
ByteDance Allegedly Trained "For You" Algorithm Using Content Scraped without Consent from Other Social Platforms
ByteDance allegedly scraped short-form videos, usernames, profile pictures, and descriptions of accounts on Instagram, Snapchat, and other sources, and uploaded them without consent on Flipagram, TikTok’s predecessor, in order to improve its “For You” algorithm's performance on American users.
Facebook's 'Tag Suggestions' Allegedly Stored Biometric Data without User Consent
Facebook's initial version of the its Tag Suggestions feature where users were offered suggestions about the identity of people's faces in photos allegedly stored biometric data without consent, violating the Illinois Biometric Information Privacy Act.
Facial Recognition Researchers Allegedly Used YouTube Videos of Transgender People Without Consent
YouTube videos of transgender people used by researchers to study facial recognition during gender transitions were allegedly used and distributed without permission.