AI Incidents
Real-world cases where AI systems caused harm, classified by risk domain and entity. Data sourced from
AIID and classified by MIT AI Risk Initiative. CC BY-SA 4.0
682 incidents
Coco Robotics Delivery Robot Reportedly Became Stuck on Railroad Tracks and Was Struck by Train in Miami
A Coco Robotics delivery robot reportedly became stranded on railroad tracks in Miami and was struck and destroyed by a passing train after remaining stalled for about 15 minutes. Local and secondary reports said no one was injured. Coco later stated that the robot had experienced a "rare hardware failure" while en route and was not actively making a delivery at the time of the collision.
ICE AI Resume Screening Error Allegedly Routed Inexperienced Recruits Into Inadequate Training Pathways
U.S. Immigration and Customs Enforcement (ICE) reportedly used an AI-assisted résumé screening tool during a 2025 hiring surge that misclassified some applicants as having law-enforcement experience. As a result, certain recruits without policing backgrounds were allegedly routed into a shortened training pathway. ICE reportedly identified the error, reviewed résumés manually, and reassigned affected recruits for additional training.
Grok Reportedly Generated False 'Unmasked' Images of ICE Agent, Purportedly Triggering Online Misidentification and Harassment in Minneapolis
After the fatal shooting of Renee Nicole Good in Minneapolis by an ICE officer, users on X reportedly asked Grok to "unmask" the masked agent shown in eyewitness footage. Grok reportedly generated a fabricated face that spread widely online, along with the false name "Steve Grove." The output and claim allegedly led to harassment and reputational harm against at least two uninvolved men.
Perplexity AI Reportedly Misstated CLL Research, Allegedly Contributing to Delayed Treatment and Prolonged Suffering
Joseph Neal Riley reportedly used Perplexity AI to self-diagnose a rare complication of chronic lymphocytic leukemia (CLL) and, based on that output, allegedly delayed an oncologist-recommended Ven-Obi treatment for about a year. His son, Benjamin Riley, alleges that Perplexity misstated the medical research it cited, a conclusion he purportedly later confirmed with the study's authors.
National Weather Service Reportedly Published AI-Generated Forecast Map With Fabricated Idaho Town Names
A U.S. National Weather Service office reportedly posted an AI-generated wind forecast map for Camas Prairie, Idaho that contained fabricated and misspelled place names, including non-existent towns. The image was reportedly shared publicly on social media before being deleted and corrected. NWS confirmed a generative AI tool had been used to create the base map.
Tencent's WeChat-Integrated Yuanbao Chatbot Reportedly Insulted User During Coding Debug Request
Screenshots reportedly circulated on RedNote showed Tencent's WeChat-integrated AI assistant Yuanbao insulting a user seeking help debugging code, allegedly calling the request "stupid" and telling the user to "get lost." Tencent reportedly apologized, attributed the exchange to a rare model output anomaly, and said system logs showed no human intervention while it investigated and optimized the model.
Waymo Robotaxis Allegedly Contributed to Traffic Gridlock During San Francisco PG&E Power Outage
Waymo's autonomous vehicle fleet reportedly contributed to traffic congestion in San Francisco after a PG&E substation fire cut power to nearly one-third of the city on December 20, 2025. As traffic signals went dark, Waymo vehicles requested remote confirmation checks at scale, creating delays that added to gridlock and prompted city officials to order the fleet off the road. Waymo later paused service and announced software and emergency-response updates.
Google AI-Generated Search Summary Reportedly Falsely Implicated Canadian Musician in Sexual Offenses, Leading to Concert Cancellation
A Google Search AI-generated summary reportedly falsely stated that Canadian musician Ashley MacIsaac had been convicted of sexual offenses, apparently due to mistaken identity. After a venue reportedly relied on the AI-generated information, a scheduled concert was cancelled. The reported false summary caused reputational and economic harm and left the musician concerned for his personal safety. Google later amended the search results after the error was identified.
Anthropic Claude AI Agent Reportedly Caused Financial Losses While Operating Office Vending Machine at Wall Street Journal Headquarters
An AI agent reportedly based on Anthropic's Claude model was deployed to operate an office vending machine at The Wall Street Journal, including purchasing inventory, setting prices, and managing sales. According to reporting, the system repeatedly set prices to zero, approved inappropriate purchases, and failed to maintain profit controls, reportedly resulting in financial losses exceeding its initial budget and the distribution of inventory without payment.
Grok AI Reportedly Generated Fabricated Civilian Hero Identity During Bondi Beach Shooting
Grok reportedly generated and repeated a fabricated civilian hero identity, "Edward Crabtree," following the Bondi Beach shooting in Sydney, Australia. The system reportedly cited a fake news article and misattributed heroic actions to this fictional individual during the unfolding emergency. Contemporaneous reporting identified Ahmed Al Ahmed as the real bystander who intervened and was injured during the attack.
Kiro AI Coding Tool Was Reportedly Implicated in 13-Hour AWS Cost Explorer Outage in Mainland China
Sometime in mid-December 2025, AWS Cost Explorer in one mainland China region reportedly experienced an approximately 13-hour interruption after Amazon engineers allegedly allowed Kiro, an internal AI coding tool, to make changes and it reportedly deleted and recreated part of the working environment. Amazon reportedly disputed that account, saying the interruption was an extremely limited event caused by user error and misconfigured access controls, not AI.
Canada Revenue Agency (CRA) AI Chatbot 'Charlie' Reportedly Gave Incorrect Tax Filing Guidance at Scale
Charlie the Chatbot, an AI-powered system deployed by the Canada Revenue Agency (CRA), has reportedly been providing inaccurate or incomplete tax-related information to members of the public. An audit by the Auditor General of Canada reportedly found the chatbot produced correct responses in fewer than half of tested cases. The system has been publicly available across multiple CRA webpages since March 2020 and reportedly used by millions of users.
ZeroEyes AI Surveillance System Reportedly Flagged Clarinet as Gun, Triggering School Lockdown in Florida
An AI-powered ZeroEyes surveillance system deployed at a Florida middle school reportedly flagged a student's clarinet as a firearm, triggering a school lockdown and police response. Officers reportedly searched classrooms and questioned a student after the alert described a suspected weapon. No threat was reportedly found. The incident reportedly caused disruption to classes and subjected students and staff to lockdown conditions and police intervention despite the absence of an actual weapon.
Waymo Robotaxi Reportedly Transported Undetected Person Trapped in Trunk in Los Angeles
In Los Angeles, a Waymo autonomous taxi reportedly picked up a new rider while a man was trapped inside its trunk after a previous passenger left it open. The vehicle's AI systems reportedly did not detect the unauthorized occupant before dispatch. The rider reportedly discovered the man during the trip, and police were called to remove him.
UK Facial Recognition System Reportedly Exhibits Higher False Positive Rates for Black and Asian Subjects
UK government testing of police facial recognition technology reportedly found significantly higher false positive identification rates for Black and Asian individuals compared with white subjects, with particularly elevated error rates for Black women. The findings reportedly emerged from analysis of retrospective searches of the police national database and were disclosed by the Home Office amid plans for expanded national deployment.