AI Incidents
Real-world cases where AI systems caused harm, classified by risk domain and entity. Data sourced from 
AIID and classified by 
MIT AI Risk Initiative. CC BY-SA 4.0
287 incidents
Sudden Braking by Tesla Allegedly on Self-Driving Mode Caused Multi-Car Pileup in Tunnel
A Tesla driver alleged Full Self Driving (FSD) braking unexpectedly as the cause for an eight-car pileup in San Francisco which led to minor injuries of nine people.
Apple Devices Mistook Skiing Activities, Dialed False Distress Emergency Calls
Apple devices of skiers and snowboarders reportedly misclassified winter activities as accidents, which resulted in numerous false inadvertent distress calls to 911 dispatchers.
XPeng P7 Crashed into Truck in Shangdong While on Automatic Navigation Assisted Driving
An XPeng P7 was operating on Navigation Guided Pilot (NGP) mode automatic navigation assisted driving system as it collided with a truck on a highway in Shandong, causing slight injuries to its driver.
Google’s Automated Child Abuse Detection Wrongfully Flagged a Parent’s Naked Photo of His Child
Google’s automated detection of abusive images of children incorrectly flagged a parent’s photo intended for a healthcare provider, resulting in a false police report of child abuse, and loss of access to his online accounts and information.
Tesla Autopilot Misidentified On-Road Horse-Drawn Carriage
Tesla Autopilot's computer vision system was shown in a video mistaking a horse-drawn carriage for other forms of transport such as a truck, a car, and a human following a car.
CFPB Reportedly Finds Hello Digit's Automated Savings Algorithm Caused Overdrafts and Orders Redress with $2.7M Penalty
Hello Digit's automated savings product allegedly transferred funds from users' checking accounts via a proprietary algorithm that reportedly caused overdrafts and bank fees despite a "no overdraft" guarantee. The Consumer Financial Protection Bureau (CFPB) reportedly also found the company denied many reimbursement requests and kept interest earned on customer funds. Hello Digit was ordered to provide redress and pay a $2.7M civil penalty.
Tesla Model 3 Sedan on Autopilot Killed Motorcyclist in a Rear-End Collision in Utah
A Tesla Model 3 operating on Autopilot mode slammed into the back of a Harley-Davidson motorcycle on an interstate in Utah, throwing the rider from the bike and killing him instantly.
Chess-Playing Robot Broke Child's Finger in Russia
A chess robot at a tournament in Russia broke the finger of a child who reached onto the board before the robot had completed its move
AI-Enabled TruDi Navigation System Was Alleged to Have Contributed to Patient's Stroke During June 2022 Sinus Procedure
Patient Erin Ralph allegedly suffered carotid-artery injury and a stroke after a June 23, 2022 sinus procedure in Texas in which surgeon Marc Dean reportedly used Acclarent's AI-enabled TruDi Navigation System. Ralph's lawsuit alleged TruDi misinformed Dean about the instrument's position inside her head; Acclarent and Integra LifeSciences, which later acquired Acclarent, reportedly denied a causal connection.
Cruise AV Ran Over Fire Hose in Active Fire Scene
A Cruise AV ran over a fire hose that was being used in an active firefighting area.
False Negatives for Water Quality-Associated Beach Closures
Toronto’s use of AI predictive modeling (AIPM) which had replaced existing methodology as the only determiner of beach water quality raised concerns about its accuracy, after allegedly conflicting results were found by a local water advocacy group using traditional means.
Cruise’s Self-Driving Car Involved in a Multiple-Injury Collision at an San Francisco Intersection
A Cruise autonomous vehicle was involved in a crash at an intersection in San Francisco when making a left turn in front of a Toyota Prius traveling in an opposite direction, which caused occupants in both cars to sustain injuries.
Cruise's Self-Driving Cars Allegedly Lost Connection to Their Server, Causing Traffic Blockages in San Francisco
Cruise’s autonomous vehicles were shown on video stopping in the middle of the road and causing blockages in San Francisco, as they were disabled allegedly due to lost connection to their company’s server.
Fatal Crash Involving Tesla Full Self-Driving Claims Employee's Life
A Tesla employee, Hans von Ohain, was killed in a crash while allegedly using the Full Self-Driving feature. The car failed to navigate mountain curves, leading to a fatal collision, possibly making von Ohain the first known fatality of the Full Self-Driving feature.
Amazon Fresh Cameras Failed to Register Purchased Items
Amazon Fresh's system of tracking cameras in its cashier-less stores was reported by shoppers for failing to detect items they purchased.