AI Incidents
Real-world cases where AI systems caused harm, classified by risk domain and entity. Data sourced from 
AIID and classified by 
MIT AI Risk Initiative. CC BY-SA 4.0
289 incidents
Facebook AI-Supported Moderation for Ads Failed to Detect Violating Content
Facebook's ad moderation system involving algorithms failed to flag hateful language and violating content such as calls for killings for ads in English and Swahili.
A Robot at a Tesla Factory in Texas Allegedly Injured an Engineer
A Tesla manufacturing robot at the Giga Texas factory is reported to have malfunctioned, injuring an engineer. The robot, which was designed for handling car parts, is described as having caused a significant open wound in the engineer. This incident occurred in the context of broader safety concerns at the factory, with evidence suggesting underreporting of workplace accidents. The 2021 incident highlights the risks associated with robotic automation in industrial settings.
DUI Arrest Case Allegedly Based Only on ShotSpotter's Alert
A car stop resulting in a DUI arrest of its driver was allegedly based solely on a ShotSpotter alert, the reliability of which came into question by public defenders, who subpoenaed the company to assess its gunshot alert system.
Tesla on FSD Reportedly Drove into the Wrong Lane in California
A Tesla Model Y in Full Self-Driving (FSD) mode drove into the wrong lane after making a left turn despite its driver allegedly attempting to overtake its driving, resulting in a non-fatal collision with another vehicle in the wrong lane in Brea, California.
Zillow Shut Down Zillow Offers Division Allegedly Due to Predictive Pricing Tool's Insufficient Accuracy
Zillow's AI-powered predictive pricing tool Zestimate was allegedly not able to accurately forecast housing prices three to six months in advance due to rapid market changes, prompting division shutdown and layoff of a few thousand employees.
California Regulator Suspended Pony.ai's Driverless Testing Permit Following a Non-Fatal Collision
A Pony.ai vehicle operating in autonomous mode crashed into a center divider and a traffic sign in San Francisco, prompting a regulator to suspend the driverless testing permit for the startup.
Traffic Camera Misread Text on Pedestrian's Shirt as License Plate, Causing UK Officials to Issue Fine to an Unrelated Person
A Bath resident was wrongly fined by the local officials because an automated license plate recognition camera misread the text on her shirt as a license plate number.
Amazon's AI Cameras Incorrectly Penalized Delivery Drivers for Mistakes They Did Not Make
Amazon's automated performance evaluation system involving AI-powered cameras incorrectly punished delivery drivers for non-existent mistakes, impacting their chances for bonuses and rewards.
Apple’s AVs Reportedly Struggled to Navigate Streets in Silicon Valley Test Drives
Apple’s autonomous cars were reported to have bumped into curbs and struggled to stay in their lanes after crossing intersections during an on-road test drives near the company’s Silicon Valley headquarters.
Epic Systems’s Sepsis Prediction Algorithms Revealed to Have High Error Rates on Seriously Ill Patients
Epic System's sepsis prediction algorithms was shown by investigators at the University of Michigan Hospital to have high rates of false positives and false negatives, allegedly delivering inaccurate and irrelevant information on patients, contrasting sharply with their published claims.
AI Tools Failed to Sufficiently Predict COVID Patients, Some Potentially Harmful
AI tools failed to sufficiently predict COVID patients, some potentially harmful.
Tesla's Autopilot Misidentified the Moon as Yellow Stop Light
Tesla's Autopilot was shown on video by its owner mistaking the moon for a yellow stop light, allegedly causing the vehicle to keep slowing down.
Facebook's Automated Moderation Flagged Gardening Group's Language Use by Mistake
Facebook's automated system flagged gardening groups' use of "hoe" and violent language against bugs as a violation by mistake.
Three Robots Collided, Sparking Fire in a Grocer's Warehouse in UK
A collision involving three robots at an Ocado's warehouse in Erith, UK, resulting in a fire but no reports of injuries.
SoftBank's Humanoid Robot, Pepper, Reportedly Frequently Made Errors, Prompting Dismissal
SoftBank's robot allegedly kept making mechanical errors, taking unplanned breaks, failing to recognize previously-met people, and breaking down during practice runs.