AI Incidents
Real-world cases where AI systems caused harm, classified by risk domain and entity. Data sourced from 
AIID and classified by 
MIT AI Risk Initiative. CC BY-SA 4.0
1,751 incidents
Driverless Train in Delhi Crashes due to Braking Failure
A driverless metro train in Delhi, India crashed during a test run due to faulty brakes.
Instagram's Exposure of Harmful Content Allegedly Contributed to Teenage Girl's Suicide
Instagram was ruled by a judge to have contributed to the death of a teenage girl in the UK allegedly through its exposure and recommendation of suicide, self-harm, and depressive content.
Robot Deployed by Animal Shelter to Patrol Sidewalks outside Its Office, Warding off Homeless People in San Francisco
Society for the Prevention of Cruelty to Animals (SPCA) deployed a Knightscope robot to autonomously patrol the area outside its office and ward off homeless people, which was criticized by residents as a tool of intimidation and ordered by the city of San Francisco to stop its use on a public right-of-way.
Amazon Alexa Plays Loud Music when Owner is Away
An Amazon Alexa, without instruction to do so, began playing loud music in the early morning while the homeowner was away leading to police breaking into their house to turn off the device.
Las Vegas Self-Driving Bus Involved in Accident
A self-driving public shuttle by Keolis North America and Navya was involved in a collision with a human-driven delivery truck in Las Vegas, Nevada on its first day of service.
iPhone Face ID Failed to Recognize Users’ Morning Faces
The Face ID feature on iPhone allowing users to unlock their phones via facial recognition was reported by users for not recognizing their faces in the morning.
Biased Sentiment Analysis
Google Cloud's Natural Language API provided racist, homophobic, amd antisemitic sentiment analyses.
Facebook translates 'good morning' into 'attack them', leading to arrest
Facebook's automatic language translation software incorrectly translated an Arabic post saying "Good morning" into Hebrew saying "hurt them," leading to the arrest of a Palestinian man in Beitar Illit, Israel.
Russian Chatbot Supports Stalin and Violence
Yandex, a Russian technology company, released an artificially intelligent chat bot named Alice which began to reply to questions with racist, pro-stalin, and pro-violence responses
WeChat’s Machine Translation Gave a Racist English Translation for the Chinese Term for “Black Foreigner”
The Chinese platform WeChat provided an inappropriate and racist English translation for the Chinese term for “black foreigner” in its messaging app.
Google Fined for Changing Shopping Algorithms in EU to Favor Own Service
Google was fined by EU Commission for changing its shopping algorithms in Europe to favor its own comparison service over competitors, resulting in anti-competitive effects.
Offensive Instagram User Content Displayed as Facebook Ad
An Instagram user’s image containing violent content was reportedly used as advertisement on Facebook allegedly via automated means.
Amazon Reportedly Recommends Explosive-Producing Ingredients as 'Frequently Bought Together' Items for Chemicals
Amazon was reported to have shown chemical combinations for producing explosives and incendiary devices as "frequently bought together" items via automated recommendation.
AI-Assisted Body Scanners Reportedly Subjected Transgender Travelers to Invasive Body Searches
Transportation Security Administration (TSA)'s use of image-processing body scanners at airports led transgender and gender-nonconforming travelers to be subjected to allegedly discriminatory and invasive searches, such as being asked to remove undergarments in private rooms by officers not of their gender.
Hackers Break Apple Face ID
Vietnamese security firm Bkav created an improved mask to bypass Apple's Face ID