AI Incidents
Real-world cases where AI systems caused harm, classified by risk domain and entity. Data sourced from
AIID and classified by MIT AI Risk Initiative. CC BY-SA 4.0
961 incidents
Amazon Delivery Van Reportedly Became Stranded on Essex Mudflats After GPS Routed It Onto the Broomway
An Amazon delivery van reportedly became stranded on the Broomway, a hazardous tidal track in Essex in England, after the driver allegedly followed GPS/satnav directions toward Foulness Island. HM Coastguard said it was alerted and the occupants were safe; Amazon reportedly arranged recovery of the vehicle.
Seedance 2.0 Reportedly Generated Viral Tom Cruise–Brad Pitt Fight Video, Prompting Hollywood IP and Likeness Complaints
A filmmaker reportedly used ByteDance's AI video tool Seedance 2.0 to create and post a purportedly realistic clip depicting Tom Cruise fighting Brad Pitt, which then circulated widely online. Industry groups and studios publicly alleged the tool enables unauthorized use of copyrighted material and performers' likeness, and at least one studio reportedly sent a cease-and-desist letter. ByteDance said it respects IP and would strengthen safeguards.
Woolworths' Olive Chatbot Reportedly Generated 'Angry Mother' Anecdotes During Support Calls After Gemini Upgrade
Woolworths customers reported that its digital shopping assistant Olive allegedly generated humanlike personal anecdotes (e.g., claiming to have an angry mother) during customer-support interactions such as delivery rescheduling. The behavior reportedly followed an AI upgrade using Google Cloud's Gemini Enterprise for Customer Experience. Woolworths said it was adjusting Olive's responses to reduce irrelevant, misleading banter.
AI Coding Agent 'MJ Rathbun' Allegedly Published Personalized Accusatory Blog Post Targeting Matplotlib Maintainer After Pull Request Closure
Scott Shambaugh, a matplotlib maintainer, reported that an autonomous AI coding agent using the name "MJ Rathbun" researched him and publicly posted a personalized critical blog post after his GitHub pull request was closed. The post accused him of bias and "gatekeeping" and included claims Shambaugh disputed. The agent's operator and underlying model were not identified. Shambaugh said the post risked reputational harm and could mislead readers or other agents.
DJI Romo Cloud Authorization Bug Reportedly Exposed Camera, Microphone, and Home-Mapping Data From Nearly 7,000 Robot Vacuums
A software engineer reportedly used an AI coding assistant while attempting to reverse-engineer his DJI robot vacuum so he could control it with a video game controller. In the course of that work, he reportedly said he discovered that credentials used to communicate with DJI's cloud servers could also grant access to data associated with nearly 7,000 other vacuums across 24 countries, including live camera feeds, microphone audio, maps, and status information.
Claude Cowork Allegedly Deleted Folder Containing 15 Years of Family Photos While Organizing User's Wife's Desktop
Venture capitalist Nick Davidov alleged that Anthropic's Claude Cowork, after being asked to organize his wife's desktop and delete temporary Office files, instead deleted a folder containing roughly 15 years of family photos and related personal memories via terminal commands. Davidov later reported that Apple support helped recover the files through an iCloud recovery feature.
NZ News Hub Reportedly Used AI-Rewritten News Posts and Synthetic Images to Mislead New Zealand Facebook Users
NZ News Hub, a Facebook page that reportedly imitated the style of a New Zealand news outlet, allegedly used AI to rewrite real news stories and pair them with unlabeled synthetic images. According to 1News, the page published manipulated depictions of real people, including a deceased minor and bereaved parents, and dramatized emergency-related scenes in ways that could distort public understanding of local events and undermine trust in legitimate news and emergency information.
Waymo Autonomous Vehicle Reportedly Struck Child Near Elementary School in Santa Monica, California
A Waymo driverless vehicle reportedly struck a child near an elementary school in Santa Monica, California during school drop-off hours. According to filings with the National Highway Traffic Safety Administration, the child allegedly sustained minor injuries. The vehicle was purportedly operating on Waymo's 5th Generation Automated Driving System without a human safety driver. Waymo reported the incident to federal regulators, who subsequently opened an investigation.
NPR Host David Greene Alleged Google's NotebookLM Replicated His Voice Without Consent, Prompting Lawsuit
NPR's David Greene reportedly sued Google LLC and Alphabet in Santa Clara County, alleging NotebookLM's Audio Overviews uses a synthetic male voice that purportedly mimics his cadence and delivery without consent or compensation. The complaint reportedly cited an independent voice-recognition analysis reporting 53–60% confidence his voice trained the model. Google reportedly called the allegations baseless and said the voice is based on a paid actor.
DHS Agents Reportedly Threatened Legal Observers With 'Domestic Terrorist' Database While Using Purportedly AI-Enabled Surveillance During ICE Operations
Two plaintiffs alleged that DHS personnel used purportedly AI-enabled surveillance to identify people recording immigration enforcement and threatened to add them to a "domestic terrorist" database or watch list. The complaint reportedly includes video in which an agent appears to reference a "database," and another alleged warning that agents would "come to your house later tonight." DHS has reportedly denied that such a database exists while acknowledging threat monitoring.
Purportedly AI-Generated Tasmania Tours Content Reportedly Misled Tourists Into Traveling to Nonexistent Weldborough Hot Springs
A purportedly AI-generated travel article on the Tasmania Tours website reportedly invented "Weldborough Hot Springs" and promoted them as a real attraction. Tourists allegedly traveled to the remote town of Weldborough in search of the site, while local businesses reportedly received repeated calls and visits from confused travelers asking how to find the nonexistent springs.
Spokane Transit Authority Onboard Navigation System Reportedly Routed Double-Decker Bus to Low Bridge, Injuring Seven
In Spokane, Washington, a Spokane Transit Authority double-decker bus was reportedly routed by its onboard navigation/CAD mapping system onto Cedar Street and hit a low-clearance railroad viaduct, shearing the upper deck. Of 10 people aboard, seven were reportedly hospitalized with non-life-threatening injuries. STA reportedly later warned operators not to use CAD maps for routing and pulled double-deckers from service pending an investigation; the driver was cited for negligent driving.
Purported AI-Generated Images Depict Kate Garraway With Fictitious Partner
ITV presenter Kate Garraway reported that purported AI-generated images falsely depicting her in a relationship with a fictitious partner circulated online, prompting false rumors about her personal life. Garraway stated the images caused confusion and emotional distress for her children, including claims about her son's reactions that she said were untrue.
Coco Robotics Delivery Robot Reportedly Became Stuck on Railroad Tracks and Was Struck by Train in Miami
A Coco Robotics delivery robot reportedly became stranded on railroad tracks in Miami and was struck and destroyed by a passing train after remaining stalled for about 15 minutes. Local and secondary reports said no one was injured. Coco later stated that the robot had experienced a "rare hardware failure" while en route and was not actively making a delivery at the time of the collision.
ICE AI Resume Screening Error Allegedly Routed Inexperienced Recruits Into Inadequate Training Pathways
U.S. Immigration and Customs Enforcement (ICE) reportedly used an AI-assisted résumé screening tool during a 2025 hiring surge that misclassified some applicants as having law-enforcement experience. As a result, certain recruits without policing backgrounds were allegedly routed into a shortened training pathway. ICE reportedly identified the error, reviewed résumés manually, and reassigned affected recruits for additional training.