AI Incidents
Real-world cases where AI systems caused harm, classified by risk domain and entity. Data sourced from 
AIID and classified by 
MIT AI Risk Initiative. CC BY-SA 4.0
112 incidents
OpenAI's Training Data for LLMs Allegedly Comprised of Copyrighted Books
Two authors alleged in a class action lawsuit OpenAI infringed authors' copyrights by incorporating illegal "shadow libraries" offering copyrighted books without permission in the training data of its generative LLMs, such as ChatGPT.
Calgary Malls Reportedly Deployed Facial Recognition Without Customer Consent
Facial recognition (FRT) was reportedly deployed in some Calgary-area malls to approximate customer age and gender without explicit consent, which a privacy expert warned was a cause for concern.
Amazon Echo Mistakenly Recorded and Sent Private Conversation to Random Contact
Amazon Echo misinterpreted a background conversation between a husband and wife as instructions for recording a message and sending it to one of the husband's employees.
Amazon Allegedly Violated Children's Privacy through Default Voice Collection Settings
Amazon's retention of children' voice recordings indefinitely as the default setting reportedly to train Alexa's voice recognition for Alexa-enabled devices was charged by the FTC and DOJ to violate COPPA Rule.
Facial Recognition Program in São Paulo Metro Stations Suspended for Illegal and Disproportionate Violation of Citizens' Right to Privacy
A facial recognition program rolled out by São Paulo Metro Stations was suspended following a court ruling in response to a lawsuit by civil society organizations, who cited fear of it being integrated with other electronic surveillance entities without consent, and lack of transparency about the biometric data collection process of metro users.
Hackers Break Apple Face ID
Vietnamese security firm Bkav created an improved mask to bypass Apple's Face ID
Identical Twins Can Open Apple FaceID Protected Devices
Apple's iPhone FaceID can be opened by an identical twin of the person who has registered their face to unlock the phone.
Researchers' Homosexual-Men Detection Model Denounced as a Threat to LGBTQ People's Safety and Privacy
Researchers at Stanford Graduate School of Business developed a model that determined, on a binary scale, whether someone was homosexual using only his facial image, which advocacy groups such as GLAAD and the Human Rights Campaign denounced as flawed science and threatening to LGBTQ folks.
UK High Court Found Sky Betting & Gaming Unlawfully Used Automated Profiling and Targeted Marketing to Exploit a Recovering Problem Gambler
In the UK, the High Court found that Sky Betting & Gaming unlawfully used automated profiling and targeted direct marketing to pursue a recovering problem gambler from July 28, 2017 onward without valid consent. Sky reportedly treated him as a high-value customer despite addiction indicators.
Clearview AI Algorithm Built on Photos Scraped from Social Media Profiles without Consent
Face-matching algorithm by Clearview AI was built using scraped images from social media sites such as Instagram and Facebook without user consent, violating social media site policies, and allegedly privacy regulations.
BBC Reporter's Twin Brother Cracked HSBC's Voice ID Authentication
HSBC’s voice recognition authentication system was fooled after seven repeated attempts by a BBC reporter's twin brother who mimicked his voice to access his bank account.
Facebook Reportedly Outed Sex Workers through Friend Recommendations
Facebook's "People You May Know" feature reportedly outed sex workers by recommending clients to their personal accounts or family members to their business accounts with no option to opt out.
ByteDance Allegedly Trained "For You" Algorithm Using Content Scraped without Consent from Other Social Platforms
ByteDance allegedly scraped short-form videos, usernames, profile pictures, and descriptions of accounts on Instagram, Snapchat, and other sources, and uploaded them without consent on Flipagram, TikTok’s predecessor, in order to improve its “For You” algorithm's performance on American users.
PimEyes's Facial Recognition AI Allegedly Lacked Safeguards to Prevent Itself from Being Abused
PimEyes offered its subscription-based AI service to anyone in the public to search for matching facial images across the internet, which critics said lacked public oversight and government rules to prevent itself from misuse such as stalking women.
Facial Recognition Smart Phone App 'Blue Wolf' Reportedly Monitored Palestinians in the West Bank
A surveillance program involving facial recognition and algorithmic recommendations, Blue Wolf, was reportedly deployed by the Israeli military to monitor Palestinians in the West Bank.