AI Incidents
Real-world cases where AI systems caused harm, classified by risk domain and entity. Data sourced from 
AIID and classified by 
MIT AI Risk Initiative. CC BY-SA 4.0
314 incidents
AI-Generated Text Detectors Reportedly Misclassified Human and AI-Written Text
AI-generated text detectors, including OpenAI’s AI Text Classifier, GPTZero, and Originality.ai, were publicly tested in early 2023 and reportedly produced false positives, false negatives, and easy evasion. OpenAI said its classifier identified only 26% of AI-written samples as likely AI-written and falsely labeled 9% of human-written text.
Firefighters Smashed Cruise AV's Front Window to Stop It from Running over Fire Hoses
Local firefighters were only able to stop a Cruise AV from driving over fire hoses that were in use in an active fire scene when they shattered its front window.
Turnitin's ChatGPT-Detection Tool Falsely Flagged Student Essays as AI-Generated
Turnitin's tool to detect writing generated by ChatGPT was reported for incorrectly flagging high school students' original essays as AI-generated, accusations of which are argued as reinforcement of bias from teachers due to the inability to compare against source documents.
Twitter's AI Moderation Tool Misidentified Rockets as Pornography
Twitter's automated content moderation misidentified images of rocket launches as pornographic content, prompting incorrect account suspensions.
ShotSpotter Failed to Alert Authorities of Mass Shooting in North Carolina
ShotSpotter did not detect gunshots and alert Durham police of a drive-by shooting in Durham, North Carolina which left five people in hospital on New Year's Day.
Southwest Airlines Crew Scheduling Solver Degenerates Flight Network
Southwest Airlines left passengers stranded for days throughout the flight network when Southwest crew scheduling software repeatedly failed to recover from weather-induced flight cancellations.
Facebook's Automated Moderation Allowed Ads Threatening Election Workers to be Posted
Facebook's automated moderating system failed to flag and allowed ads containing explicit violent language against election workers to be published.
Sudden Braking by Tesla Allegedly on Self-Driving Mode Caused Multi-Car Pileup in Tunnel
A Tesla driver alleged Full Self Driving (FSD) braking unexpectedly as the cause for an eight-car pileup in San Francisco which led to minor injuries of nine people.
Apple Devices Mistook Skiing Activities, Dialed False Distress Emergency Calls
Apple devices of skiers and snowboarders reportedly misclassified winter activities as accidents, which resulted in numerous false inadvertent distress calls to 911 dispatchers.
XPeng P7 Crashed into Truck in Shangdong While on Automatic Navigation Assisted Driving
An XPeng P7 was operating on Navigation Guided Pilot (NGP) mode automatic navigation assisted driving system as it collided with a truck on a highway in Shandong, causing slight injuries to its driver.
Delivery Robot Rolled Through Crime Scene
A Serve Robotics delivery robot was shown on video rolling through a crime scene blocked off by police tape.
Google’s Automated Child Abuse Detection Wrongfully Flagged a Parent’s Naked Photo of His Child
Google’s automated detection of abusive images of children incorrectly flagged a parent’s photo intended for a healthcare provider, resulting in a false police report of child abuse, and loss of access to his online accounts and information.
Tesla Autopilot Misidentified On-Road Horse-Drawn Carriage
Tesla Autopilot's computer vision system was shown in a video mistaking a horse-drawn carriage for other forms of transport such as a truck, a car, and a human following a car.
CFPB Reportedly Finds Hello Digit's Automated Savings Algorithm Caused Overdrafts and Orders Redress with $2.7M Penalty
Hello Digit's automated savings product allegedly transferred funds from users' checking accounts via a proprietary algorithm that reportedly caused overdrafts and bank fees despite a "no overdraft" guarantee. The Consumer Financial Protection Bureau (CFPB) reportedly also found the company denied many reimbursement requests and kept interest earned on customer funds. Hello Digit was ordered to provide redress and pay a $2.7M civil penalty.
Tesla Model 3 Sedan on Autopilot Killed Motorcyclist in a Rear-End Collision in Utah
A Tesla Model 3 operating on Autopilot mode slammed into the back of a Harley-Davidson motorcycle on an interstate in Utah, throwing the rider from the bike and killing him instantly.
Risk Taxonomy
Caused By
Year Trend
* Oct 2026, ~320 projected full year
AIID · MIT AIRI · CC BY-SA 4.0