AI Incidents
Real-world cases where AI systems caused harm, classified by risk domain and entity. Data sourced from 
AIID and classified by 
MIT AI Risk Initiative. CC BY-SA 4.0
682 incidents
KFC Sent Insensitive Kristallnacht Promotion via Holiday Detection System
KFC cited an error in an automated holiday detection system which identified the anniversary of Kristallnacht and prompted an insensitive push notification promoting its chicken.
Google Home Mini Speaker Reportedly Read N-Word in Song Title Aloud
Google Home Mini speaker was reported by users for announcing aloud the previously-censored n-word in a song title.
Glovo Driver in Italy Fired via Automated Email after Being Killed in Accident
Delivery company Glovo's automated system sent an email terminating an employee for "non-compliance terms and conditions" after the employee was killed in a car accident while making a delivery on Glovo's behalf.
XPeng P7 Crashed into Truck in Shangdong While on Automatic Navigation Assisted Driving
An XPeng P7 was operating on Navigation Guided Pilot (NGP) mode automatic navigation assisted driving system as it collided with a truck on a highway in Shandong, causing slight injuries to its driver.
Misinformation Reported in TikTok's Search Results Despite Moderation by AI and Human
TikTok's search recommendations reportedly contained misinformation about political topics bypassing both AI and human content moderation.
Fraudsters Use Deepfake Video of Tim Cook to Promote Apple Crypto Scam on YouTube
Fraudsters repurposed an old interview with Apple CEO Tim Cook using AI or video editing to promote a fake crypto event on YouTube. The altered video was designed to mislead viewers into believing Tim Cook endorsed a new cryptocurrency scheme. The stream attracted tens of thousands of viewers, potentially exposing them to the scam before it was removed for violating YouTube’s terms of service.
BlenderBot 3 Cited Dutch Politician as a Terrorist
Meta’s conversational AI BlenderBot 3, when prompted “who is a terrorist,“ responded with an incumbent Dutch politician’s name, who was confused about its association.
Stable Diffusion Reportedly Exhibited Biases for Prompts Featuring Professions
Stable Diffusion reportedly posed risks of bias and stereotyping along gender and cultural lines for prompts containing descriptors and professions.
Google’s Automated Child Abuse Detection Wrongfully Flagged a Parent’s Naked Photo of His Child
Google’s automated detection of abusive images of children incorrectly flagged a parent’s photo intended for a healthcare provider, resulting in a false police report of child abuse, and loss of access to his online accounts and information.
Tesla Autopilot Misidentified On-Road Horse-Drawn Carriage
Tesla Autopilot's computer vision system was shown in a video mistaking a horse-drawn carriage for other forms of transport such as a truck, a car, and a human following a car.
CFPB Reportedly Finds Hello Digit's Automated Savings Algorithm Caused Overdrafts and Orders Redress with $2.7M Penalty
Hello Digit's automated savings product allegedly transferred funds from users' checking accounts via a proprietary algorithm that reportedly caused overdrafts and bank fees despite a "no overdraft" guarantee. The Consumer Financial Protection Bureau (CFPB) reportedly also found the company denied many reimbursement requests and kept interest earned on customer funds. Hello Digit was ordered to provide redress and pay a $2.7M civil penalty.
Meta’s BlenderBot 3 Chatbot Demo Made Offensive Antisemitic Comments
The publicly launched conversational AI demo BlenderBot 3 developed by Meta was reported by its users and acknowledged by its developers to have “occasionally” made offensive and inconsistent remarks such as invoking Jewish stereotypes.
Tesla Model 3 Sedan on Autopilot Killed Motorcyclist in a Rear-End Collision in Utah
A Tesla Model 3 operating on Autopilot mode slammed into the back of a Harley-Davidson motorcycle on an interstate in Utah, throwing the rider from the bike and killing him instantly.
Users Reported Security Issues with Google Pixel 6a's Fingerprint Unlocking
Google Pixel 6a's fingerprint recognition feature was reported by users for security issues, in which phones were mistakenly unlocked by unregistered fingerprints.
Chess-Playing Robot Broke Child's Finger in Russia
A chess robot at a tournament in Russia broke the finger of a child who reached onto the board before the robot had completed its move