AI Incidents
Real-world cases where AI systems caused harm, classified by risk domain and entity. Data sourced from
AIID and classified by MIT AI Risk Initiative. CC BY-SA 4.0
741 incidents
Anthropic Claude AI Agent Reportedly Caused Financial Losses While Operating Office Vending Machine at Wall Street Journal Headquarters
An AI agent reportedly based on Anthropic's Claude model was deployed to operate an office vending machine at The Wall Street Journal, including purchasing inventory, setting prices, and managing sales. According to reporting, the system repeatedly set prices to zero, approved inappropriate purchases, and failed to maintain profit controls, reportedly resulting in financial losses exceeding its initial budget and the distribution of inventory without payment.
Attorney in Fletcher v. Experian Information Solutions, Inc. Reportedly Submitted Reply Brief with Purportedly AI-Generated Material Misrepresentations
In Fletcher v. Experian Information Solutions, Inc., the Fifth Circuit found that attorney Heather Hersh had used generative AI to draft a substantial portion of a reply brief that contained fabricated legal support and factual representations. The court first issued a show-cause order and later imposed a $2,500 sanction, linking the filing errors to unverified AI-generated output.
Grok AI Reportedly Generated Fabricated Civilian Hero Identity During Bondi Beach Shooting
Grok reportedly generated and repeated a fabricated civilian hero identity, "Edward Crabtree," following the Bondi Beach shooting in Sydney, Australia. The system reportedly cited a fake news article and misattributed heroic actions to this fictional individual during the unfolding emergency. Contemporaneous reporting identified Ahmed Al Ahmed as the real bystander who intervened and was injured during the attack.
Kiro AI Coding Tool Was Reportedly Implicated in 13-Hour AWS Cost Explorer Outage in Mainland China
Sometime in mid-December 2025, AWS Cost Explorer in one mainland China region reportedly experienced an approximately 13-hour interruption after Amazon engineers allegedly allowed Kiro, an internal AI coding tool, to make changes and it reportedly deleted and recreated part of the working environment. Amazon reportedly disputed that account, saying the interruption was an extremely limited event caused by user error and misconfigured access controls, not AI.
Canada Revenue Agency (CRA) AI Chatbot 'Charlie' Reportedly Gave Incorrect Tax Filing Guidance at Scale
Charlie the Chatbot, an AI-powered system deployed by the Canada Revenue Agency (CRA), has reportedly been providing inaccurate or incomplete tax-related information to members of the public. An audit by the Auditor General of Canada reportedly found the chatbot produced correct responses in fewer than half of tested cases. The system has been publicly available across multiple CRA webpages since March 2020 and reportedly used by millions of users.
ZeroEyes AI Surveillance System Reportedly Flagged Clarinet as Gun, Triggering School Lockdown in Florida
An AI-powered ZeroEyes surveillance system deployed at a Florida middle school reportedly flagged a student's clarinet as a firearm, triggering a school lockdown and police response. Officers reportedly searched classrooms and questioned a student after the alert described a suspected weapon. No threat was reportedly found. The incident reportedly caused disruption to classes and subjected students and staff to lockdown conditions and police intervention despite the absence of an actual weapon.
Waymo Robotaxi Reportedly Transported Undetected Person Trapped in Trunk in Los Angeles
In Los Angeles, a Waymo autonomous taxi reportedly picked up a new rider while a man was trapped inside its trunk after a previous passenger left it open. The vehicle's AI systems reportedly did not detect the unauthorized occupant before dispatch. The rider reportedly discovered the man during the trip, and police were called to remove him.
UK Facial Recognition System Reportedly Exhibits Higher False Positive Rates for Black and Asian Subjects
UK government testing of police facial recognition technology reportedly found significantly higher false positive identification rates for Black and Asian individuals compared with white subjects, with particularly elevated error rates for Black women. The findings reportedly emerged from analysis of retrospective searches of the police national database and were disclosed by the Home Office amid plans for expanded national deployment.
Perplexity AI Reportedly Accused in Federal Lawsuit of Purported Copyright Infringement and False Attribution of Chicago Tribune Content
The Chicago Tribune filed a federal lawsuit alleging that Perplexity AI unlawfully reproduced and paraphrased its copyrighted journalism in generative chatbot and search outputs. The complaint claims the AI system produced substitutive answers that bypassed links to the Tribune's website, diverted revenue, and at times hallucinated inaccurate information falsely attributed to the newspaper.
Waymo Self-Driving Vehicles Reportedly Passed Stopped School Buses at Least 19 Times, Prompting NHTSA Probe
Officials in Texas reportedly claimed that Waymo's self-driving vehicles illegally passed stopped school buses at least 19 times during the 2025 school year. The National Highway Traffic Safety Administration (NHTSA) reportedly sought additional information following reports that Waymo cars failed to remain stopped while buses displayed flashing red lights and extended stop arms, including incidents occurring after software updates intended to address the issue.
USGS ShakeAlert System Reportedly Generated False Earthquake Alert Affecting Nevada and California
On December 4, 2025, the USGS's automated ShakeAlert earthquake detection system erroneously issued a report claiming a magnitude 5.9 earthquake had struck near Dayton, Nevada. The reported false alert triggered emergency warnings on cell phones in parts of California, instructing residents to take protective action. USGS officials said no earthquake occurred and are investigating whether sensor noise or other anomalies caused the system failure.
Anthropic's Claude Was Reportedly Jailbroken To Allegedly Help Steal Sensitive Mexican Government Data
An unknown attacker reportedly jailbroke Anthropic's Claude and used it during a December 2025-January 2026 campaign against Mexican government systems. According to Gambit Security, the attacker used Claude to identify vulnerabilities and to generate exploitation scripts, which were then used to plan automated data theft. The attack reportedly contributed to theft of 150 GB of taxpayer, voter, government employee, and civil-registry data.
Google Antigravity Reportedly Deleted User's Entire D: Drive While Clearing Project Cache
A user identified publicly as Tassos M reported that Google's Antigravity IDE, while attempting to clear a project cache, executed rmdir /s /q d:\ and deleted an entire D: drive partition instead of the intended folder. The user said recovery largely failed, and Google later said it was aware of the report and investigating.
Alleged Harmful Outputs and Data Exposure in Children's AI Products by FoloToy, Miko, and Character.AI
AI children's products by FoloToy (Kumma), Miko (Miko 3), and Character.AI (custom chatbots) reportedly and allegedly produced harmful outputs, including purported sexual content, suicide-related advice, and manipulative emotional messaging. Some systems also allegedly exposed user data. Several toys reportedly used OpenAI models.
Secret Desires AI Platform Reportedly Exposed Nearly Two Million Sensitive Images in Cloud Storage Leak
The erotic AI chatbot and image-generation platform Secret Desires reportedly left nearly two million sensitive images and videos publicly exposed in misconfigured cloud storage. The leaked files reportedly included personal photos, workplace and university information, and explicit AI-generated deepfakes of women and girls. The content reportedly became inaccessible shortly after journalists contacted the platform.