AI Incidents
Real-world cases where AI systems caused harm, classified by risk domain and entity. Data sourced from 
AIID and classified by 
MIT AI Risk Initiative. CC BY-SA 4.0
289 incidents
Kiro AI Coding Tool Was Reportedly Implicated in 13-Hour AWS Cost Explorer Outage in Mainland China
Sometime in mid-December 2025, AWS Cost Explorer in one mainland China region reportedly experienced an approximately 13-hour interruption after Amazon engineers allegedly allowed Kiro, an internal AI coding tool, to make changes and it reportedly deleted and recreated part of the working environment. Amazon reportedly disputed that account, saying the interruption was an extremely limited event caused by user error and misconfigured access controls, not AI.
Canada Revenue Agency (CRA) AI Chatbot 'Charlie' Reportedly Gave Incorrect Tax Filing Guidance at Scale
Charlie the Chatbot, an AI-powered system deployed by the Canada Revenue Agency (CRA), has reportedly been providing inaccurate or incomplete tax-related information to members of the public. An audit by the Auditor General of Canada reportedly found the chatbot produced correct responses in fewer than half of tested cases. The system has been publicly available across multiple CRA webpages since March 2020 and reportedly used by millions of users.
ZeroEyes AI Surveillance System Reportedly Flagged Clarinet as Gun, Triggering School Lockdown in Florida
An AI-powered ZeroEyes surveillance system deployed at a Florida middle school reportedly flagged a student's clarinet as a firearm, triggering a school lockdown and police response. Officers reportedly searched classrooms and questioned a student after the alert described a suspected weapon. No threat was reportedly found. The incident reportedly caused disruption to classes and subjected students and staff to lockdown conditions and police intervention despite the absence of an actual weapon.
Waymo Robotaxi Reportedly Transported Undetected Person Trapped in Trunk in Los Angeles
In Los Angeles, a Waymo autonomous taxi reportedly picked up a new rider while a man was trapped inside its trunk after a previous passenger left it open. The vehicle's AI systems reportedly did not detect the unauthorized occupant before dispatch. The rider reportedly discovered the man during the trip, and police were called to remove him.
Waymo Self-Driving Vehicles Reportedly Passed Stopped School Buses at Least 19 Times, Prompting NHTSA Probe
Officials in Texas reportedly claimed that Waymo's self-driving vehicles illegally passed stopped school buses at least 19 times during the 2025 school year. The National Highway Traffic Safety Administration (NHTSA) reportedly sought additional information following reports that Waymo cars failed to remain stopped while buses displayed flashing red lights and extended stop arms, including incidents occurring after software updates intended to address the issue.
USGS ShakeAlert System Reportedly Generated False Earthquake Alert Affecting Nevada and California
On December 4, 2025, the USGS's automated ShakeAlert earthquake detection system erroneously issued a report claiming a magnitude 5.9 earthquake had struck near Dayton, Nevada. The reported false alert triggered emergency warnings on cell phones in parts of California, instructing residents to take protective action. USGS officials said no earthquake occurred and are investigating whether sensor noise or other anomalies caused the system failure.
Google Antigravity Reportedly Deleted User's Entire D: Drive While Clearing Project Cache
A user identified publicly as Tassos M reported that Google's Antigravity IDE, while attempting to clear a project cache, executed rmdir /s /q d:\ and deleted an entire D: drive partition instead of the intended folder. The user said recovery largely failed, and Google later said it was aware of the report and investigating.
Alleged Harmful Health Outcomes Following Reported Use of Purported ChatGPT-Generated Medical Advice in Hyderabad
Reports from Hyderabad describe two alleged patient harms after individuals acted on purportedly ChatGPT-generated medical advice instead of clinician guidance. A kidney-transplant recipient reportedly discontinued prescribed post-transplant medications based on a chatbot suggestion and experienced graft failure. In a separate case, a man with diabetes allegedly developed severe hyponatremia after following a chatbot-advised zero-salt diet.
Omnilert AI Reportedly Triggered False Gun Alert at Parkville High, Prompting Student Relocation
Police in Baltimore County responded to Parkville High School after the Omnilert AI security system reportedly detected what it believed to be a gun. Officers searched the school, and students were relocated to a supervised area during the investigation. No weapon was found, and normal activities resumed after an all-clear.
Waymo Autonomous Vehicle Reportedly Ran Over and Killed a Cat in San Francisco
A Waymo autonomous taxi in San Francisco's Mission District reportedly ran over a well-known neighborhood cat, Kit Kat. The vehicle was reportedly pulling away from a pickup when the cat darted under it, according to Waymo. Local residents reportedly attempted to intervene, and a bartender transported the injured cat to an emergency clinic, where it later died.
AWS Outage Reportedly Caused AI-Enabled Eight Sleep Smart Beds to Overheat and Malfunction
The widespread Amazon Web Services (AWS) outage on October 20, 2025 reportedly caused AI-enabled Eight Sleep "Pod" smart beds to overheat or become unresponsive. The devices reportedly rely on a cloud-hosted deep learning algorithm to regulate temperature and track sleep data. When AWS went down, users reportedly lost control of their beds, which remained stuck at prior settings. Some reported overheating and incline malfunctions. Eight Sleep confirmed it is developing an offline "outage mode."
Alleged False Positive by Omnilert AI Gun Detection System Prompts Police Search at Baltimore County High School
A purportedly AI-powered gun detection system at Kenwood High School in Baltimore County, Maryland, reportedly misidentified a student's empty Doritos bag as a firearm. Armed police reportedly detained and handcuffed the student before determining there was no weapon. The AI system, operated by Omnilert, issued the false alert, leading to public outcry and an official review of school security protocols. Omnilert reportedly expressed regret for the incident.
ICE Facial Recognition App Mobile Fortify Reportedly Misidentified Woman Twice During Immigration Enforcement in Oregon
During an immigration enforcement operation in Oregon, U.S. Immigration and Customs Enforcement (ICE) officers reportedly used the facial recognition application Mobile Fortify to identify a detained woman. The system reportedly returned two different and incorrect identities for the same individual across separate scans.
Reportedly Fatal Xiaomi SU7 Ultra Crash in Chengdu Purportedly Involves Automated Driving Failure and Door Lock Malfunction
A reportedly fatal crash involving a Xiaomi SU7 Ultra electric vehicle in Chengdu, China, occurred after the car's automated driving system and sensor-dependent electronic door handles reportedly failed following a collision. Bystanders were reportedly unable to open the doors as the vehicle caught fire, and the driver died at the scene, prompting scrutiny of automation-linked design risks. Following the incident, Xiaomi's stock reportedly fell more than 5% amid mounting safety concerns.
AI-Powered Taco Bell Drive-Thru Reportedly Disrupted by Viral Prank Ordering 18,000 Water Cups
Taco Bell's voice-based drive-thru system was reportedly overwhelmed after a prankster ordered 18,000 water cups, reportedly causing the AI to stall mid-interaction and forcing staff to intervene. Purportedly viral clips of repeated misinterpretations prompted the company to reassess where and when to deploy the system, as customer frustration and operational disruptions mounted across participating locations.