AI Incidents
Real-world cases where AI systems caused harm, classified by risk domain and entity. Data sourced from 
AIID and classified by 
MIT AI Risk Initiative. CC BY-SA 4.0
682 incidents
Instagram's Exposure of Harmful Content Allegedly Contributed to Teenage Girl's Suicide
Instagram was ruled by a judge to have contributed to the death of a teenage girl in the UK allegedly through its exposure and recommendation of suicide, self-harm, and depressive content.
Amazon Alexa Plays Loud Music when Owner is Away
An Amazon Alexa, without instruction to do so, began playing loud music in the early morning while the homeowner was away leading to police breaking into their house to turn off the device.
iPhone Face ID Failed to Recognize Users’ Morning Faces
The Face ID feature on iPhone allowing users to unlock their phones via facial recognition was reported by users for not recognizing their faces in the morning.
Biased Sentiment Analysis
Google Cloud's Natural Language API provided racist, homophobic, amd antisemitic sentiment analyses.
Facebook translates 'good morning' into 'attack them', leading to arrest
Facebook's automatic language translation software incorrectly translated an Arabic post saying "Good morning" into Hebrew saying "hurt them," leading to the arrest of a Palestinian man in Beitar Illit, Israel.
Russian Chatbot Supports Stalin and Violence
Yandex, a Russian technology company, released an artificially intelligent chat bot named Alice which began to reply to questions with racist, pro-stalin, and pro-violence responses
WeChat’s Machine Translation Gave a Racist English Translation for the Chinese Term for “Black Foreigner”
The Chinese platform WeChat provided an inappropriate and racist English translation for the Chinese term for “black foreigner” in its messaging app.
Offensive Instagram User Content Displayed as Facebook Ad
An Instagram user’s image containing violent content was reportedly used as advertisement on Facebook allegedly via automated means.
Amazon Reportedly Recommends Explosive-Producing Ingredients as 'Frequently Bought Together' Items for Chemicals
Amazon was reported to have shown chemical combinations for producing explosives and incendiary devices as "frequently bought together" items via automated recommendation.
AI-Assisted Body Scanners Reportedly Subjected Transgender Travelers to Invasive Body Searches
Transportation Security Administration (TSA)'s use of image-processing body scanners at airports led transgender and gender-nonconforming travelers to be subjected to allegedly discriminatory and invasive searches, such as being asked to remove undergarments in private rooms by officers not of their gender.
Hackers Break Apple Face ID
Vietnamese security firm Bkav created an improved mask to bypass Apple's Face ID
Identical Twins Can Open Apple FaceID Protected Devices
Apple's iPhone FaceID can be opened by an identical twin of the person who has registered their face to unlock the phone.
Facial Recognition Trial Performed Poorly at Notting Hill Carnival
The facial recognition trial by London’s Metropolitan Police Service at the Notting Hill Carnival reportedly performed poorly with a high rate of false positives.
Chinese Chatbots Question Communist Party
Chatbots on Chinese messaging service expressed anti-China sentiments, causing the messaging service to remove and reprogram the chatbots.
Tesla Sedan on Autopilot Reportedly Drove Over Dividing Curb in Washington, Resulting in Minor Vehicle Damage
A Tesla Sedan operating on Autopilot mode was not able to center itself on the road and drove over a yellow dividing curb in Redmond, Washington, causing minor damage to the vehicle’s rear suspension.