AI Incidents
Real-world cases where AI systems caused harm, classified by risk domain and entity. Data sourced from 
AIID and classified by 
MIT AI Risk Initiative. CC BY-SA 4.0
961 incidents
Biased Sentiment Analysis
Google Cloud's Natural Language API provided racist, homophobic, amd antisemitic sentiment analyses.
Facebook translates 'good morning' into 'attack them', leading to arrest
Facebook's automatic language translation software incorrectly translated an Arabic post saying "Good morning" into Hebrew saying "hurt them," leading to the arrest of a Palestinian man in Beitar Illit, Israel.
Russian Chatbot Supports Stalin and Violence
Yandex, a Russian technology company, released an artificially intelligent chat bot named Alice which began to reply to questions with racist, pro-stalin, and pro-violence responses
WeChat’s Machine Translation Gave a Racist English Translation for the Chinese Term for “Black Foreigner”
The Chinese platform WeChat provided an inappropriate and racist English translation for the Chinese term for “black foreigner” in its messaging app.
Google Fined for Changing Shopping Algorithms in EU to Favor Own Service
Google was fined by EU Commission for changing its shopping algorithms in Europe to favor its own comparison service over competitors, resulting in anti-competitive effects.
Offensive Instagram User Content Displayed as Facebook Ad
An Instagram user’s image containing violent content was reportedly used as advertisement on Facebook allegedly via automated means.
Amazon Reportedly Recommends Explosive-Producing Ingredients as 'Frequently Bought Together' Items for Chemicals
Amazon was reported to have shown chemical combinations for producing explosives and incendiary devices as "frequently bought together" items via automated recommendation.
AI-Assisted Body Scanners Reportedly Subjected Transgender Travelers to Invasive Body Searches
Transportation Security Administration (TSA)'s use of image-processing body scanners at airports led transgender and gender-nonconforming travelers to be subjected to allegedly discriminatory and invasive searches, such as being asked to remove undergarments in private rooms by officers not of their gender.
Hackers Break Apple Face ID
Vietnamese security firm Bkav created an improved mask to bypass Apple's Face ID
Identical Twins Can Open Apple FaceID Protected Devices
Apple's iPhone FaceID can be opened by an identical twin of the person who has registered their face to unlock the phone.
Facial Recognition Trial Performed Poorly at Notting Hill Carnival
The facial recognition trial by London’s Metropolitan Police Service at the Notting Hill Carnival reportedly performed poorly with a high rate of false positives.
Chinese Chatbots Question Communist Party
Chatbots on Chinese messaging service expressed anti-China sentiments, causing the messaging service to remove and reprogram the chatbots.
Tesla Sedan on Autopilot Reportedly Drove Over Dividing Curb in Washington, Resulting in Minor Vehicle Damage
A Tesla Sedan operating on Autopilot mode was not able to center itself on the road and drove over a yellow dividing curb in Redmond, Washington, causing minor damage to the vehicle’s rear suspension.
UK High Court Found Sky Betting & Gaming Unlawfully Used Automated Profiling and Targeted Marketing to Exploit a Recovering Problem Gambler
In the UK, the High Court found that Sky Betting & Gaming unlawfully used automated profiling and targeted direct marketing to pursue a recovering problem gambler from July 28, 2017 onward without valid consent. Sky reportedly treated him as a high-value customer despite addiction indicators.
Security Robot Drowns Itself in a Fountain
A Knightscope K5 security robot ran itself into a water fountain in Washington, DC.