AI Incidents
Real-world cases where AI systems caused harm, classified by risk domain and entity. Data sourced from
AIID and classified by MIT AI Risk Initiative. CC BY-SA 4.0
53 incidents
Researchers' Homosexual-Men Detection Model Denounced as a Threat to LGBTQ People's Safety and Privacy
Researchers at Stanford Graduate School of Business developed a model that determined, on a binary scale, whether someone was homosexual using only his facial image, which advocacy groups such as GLAAD and the Human Rights Campaign denounced as flawed science and threatening to LGBTQ folks.
UK High Court Found Sky Betting & Gaming Unlawfully Used Automated Profiling and Targeted Marketing to Exploit a Recovering Problem Gambler
In the UK, the High Court found that Sky Betting & Gaming unlawfully used automated profiling and targeted direct marketing to pursue a recovering problem gambler from July 28, 2017 onward without valid consent. Sky reportedly treated him as a high-value customer despite addiction indicators.
Clearview AI Algorithm Built on Photos Scraped from Social Media Profiles without Consent
Face-matching algorithm by Clearview AI was built using scraped images from social media sites such as Instagram and Facebook without user consent, violating social media site policies, and allegedly privacy regulations.
ByteDance Allegedly Trained "For You" Algorithm Using Content Scraped without Consent from Other Social Platforms
ByteDance allegedly scraped short-form videos, usernames, profile pictures, and descriptions of accounts on Instagram, Snapchat, and other sources, and uploaded them without consent on Flipagram, TikTok’s predecessor, in order to improve its “For You” algorithm's performance on American users.
Facial Recognition Smart Phone App 'Blue Wolf' Reportedly Monitored Palestinians in the West Bank
A surveillance program involving facial recognition and algorithmic recommendations, Blue Wolf, was reportedly deployed by the Israeli military to monitor Palestinians in the West Bank.
Oracle's Algorithmic Data Processing System Alleged as Unlawful and Violating Privacy Rights
Oracle's automated system involving algorithmic data processing was alleged in a lawsuit to have been unlawfully collecting personal data from millions of people and violating their privacy rights.
Facial Recognition Researchers Allegedly Used YouTube Videos of Transgender People Without Consent
YouTube videos of transgender people used by researchers to study facial recognition during gender transitions were allegedly used and distributed without permission.
Target Suggested Maternity-Related Advertisements to a Teenage Girl's Home, Allegedly Correctly Predicting Her Pregnancy via Algorithm
Target recommended maternity-related items to a family in Atlanta via ads, allegedly predicting their teenage daughter’s pregnancy before her father did, although critics have called into question the predictability of the algorithm and the authenticity of its claims.