AI Incidents
Real-world cases where AI systems caused harm, classified by risk domain and entity. Data sourced from 
AIID and classified by 
MIT AI Risk Initiative. CC BY-SA 4.0
1,751 incidents
Discord's Automated Moderation System Reportedly Wrongfully Banned More Than 8,000 Users Over Benign Images
Discord reportedly wrongfully banned more than 8,000 accounts after its automated image-moderation workflow flagged harmless uploads, including grids, spreadsheets, chessboards, and game images, as prohibited material. Discord said a bug converted temporary upload restrictions into account bans and prevented cleared accounts from being restored automatically. The company later reinstated the affected accounts.
Waymo Robotaxi Reportedly Caught Fire After Driving Over Firework in San Francisco
An unoccupied Waymo robotaxi reportedly drove over a small firework near the 1200 block of Connecticut Street in San Francisco on July 4, 2026, and caught fire. No passengers were aboard and no injuries were reported. Waymo said it coordinated with the San Francisco Fire Department and local authorities to remove the damaged vehicle.
Purported Deepfake Impersonating Dubai Crown Prince Reportedly Used to Defraud Filipino Domestic Worker
A Filipino domestic worker identified as "Maria" reportedly paid ₱100,000 (about $1,625) after a scammer deployed purportedly manipulated real-time video to impersonate Dubai Crown Prince Hamdan bin Mohammed during WhatsApp calls. The scammer reportedly claimed the money was for a marriage certificate and "royal membership card" that would help her secure a job in Dubai. Maria reportedly ended contact after noticing that the Facebook account was based in Nigeria.
Istanbul Fraud Network Reportedly Used AI-Assisted Call Center Software to Impersonate Officials and Defraud Europeans
An international fraud network operating from a call center in Maslak, Istanbul reportedly used AI-assisted software to contact people in the Czech Republic and other European countries while posing as police, prosecutors, soldiers, and bank officials. Authorities said numerous victims were defrauded for substantial sums. Investigators found 80 foreign-national suspects at the call center and seized digital materials during raids at three Istanbul locations.
LLM-Driven Ransomware Operator Dubbed JADEPUFFER Reportedly Targeted Production Database
Sysdig reported that a ransomware operator it dubbed JADEPUFFER used an LLM-driven agent to turn access through a vulnerable internet-facing Langflow deployment into a database-extortion operation. The report said the activity reached a production database server and produced concrete disruption, with the victim environment allegedly left in a damaged and unrecoverable state alongside a ransom demand.
Spokane, Washington, Police Reportedly Circulated Purported AI-Generated Image as Authentic Photo of Injured Dog
Detectives in Spokane, Washington, reportedly created a purported AI-generated image as a joke depicting a real undercover officer holding an injured dachshund. A supervisor reportedly mistook it for an authentic photograph and the image was released to news media after correcting an earlier claim that the dog had died. The Spokesman-Review published a cropped version before the department disclosed that the scene was fabricated and began reviewing its verification procedures.
City of Spokane Reportedly Distributed Purported AI-Generated Clocktower Flyer Resembling Graphic Designer Matthew Clinard's Artwork
A Spokane Parks and Recreation employee reportedly used a purported generative AI image tool to create a flyer promoting the restored Great Northern Clocktower chimes. The flyer reportedly reproduced elements of artist Matthew Clinard's commercially sold Clocktower sticker and was distributed by the mayor's office without the city-required AI disclosure. After Clinard complained publicly, the city removed the image and apologized, then began considering AI-policy and employee-training reforms.
Suspected China-Linked Hackers Reportedly Used AI Agents to Compromise Taiwanese Government Systems and Exfiltrate Personnel Records
From July 1–4, 2026, suspected China-linked hackers reportedly used a multi-agent framework built on Hermes and OpenClaw to compromise Taiwanese government systems. The agents reportedly compromised 85 credentials and used persistent access to connected systems to exfiltrate more than 2,564 personnel records. Taiwan later confirmed an overseas AI-assisted campaign against government agencies, without attributing it to China.
Purportedly AI-Powered KT Platform Reportedly Used in Forced Scamming Operation Involving Trafficked Worker in Myanmar
AP reported that traffickers at Myanmar's Tai Chang scam compound forced a man named Safeer Mohammed Koorimannil to use the AI-powered KT platform to impersonate women and target thousands of people online. The system reportedly supported the scam conversations while monitoring worker performance. Koorimannil said he was beaten for poor results and later paid 500,000 rupees ($5,300) for his release.
DuckDuckGo Search Assist Reportedly Falsely Claimed Donald Trump and JD Vance Died of Rabies
DuckDuckGo's Search Assist reportedly produced an answer stating that Donald Trump and JD Vance had died of rabies and repeated fabricated details involving Robert F. Kennedy Jr. The answer cited a false WKNA49 article alongside an unrelated ABC News report. Reporting linked the episode to adversarial web content associated with r/poisonai. DuckDuckGo said Search Assist had been "deliberately tricked," fixed the result, and planned updates.
Ten Plaintiffs in Estonia Reportedly Fined After AI-Assisted Court Filing Cited Nonexistent Researchers in Logging-Permit Dispute
Ten plaintiffs challenging a logging permit in Estonia reportedly received fines after submitting an AI-assisted document citing researchers who did not exist and studies the court could not locate. Tallinn Administrative Court held them responsible for checking the references. The plaintiffs denied intending to mislead the court; the fines became final after appeals.
Storm-1516 Reportedly Spread Fabricated Narratives Targeting Firebird Data Center in Armenia
Alethea reported that Storm-1516, a Russian influence operation, targeted Firebird's NVIDIA-powered data center under construction in Hrazdan, Armenia, with purportedly fabricated media narratives designed to make the project appear dangerous and economically unstable. The campaign allegedly used imitation tech-news articles to cast the facility as a liability for Armenia's infrastructure and Western-aligned technology ambitions.
Rep. Anna Paulina Luna's Office Reportedly Published Claude Transcript Residue on Accident in House Amendment Summary
A staffer in Rep. Anna Paulina Luna's office reportedly used Claude to prepare a summary for an amendment to the FY2027 National Defense Authorization Act and accidentally pasted chatbot transcript residue, including a timestamp and "Claude responded:" marker, into the public House Rules Committee record. The summary was reportedly later corrected. Luna confirmed that her staff used Claude for the summary, not to draft the amendment itself.
Apartment Owner and Manager UDR Allegedly Used RealPage Algorithms to Set San Diego Rents in Keller v. UDR, Inc.
In Keller v. UDR, Inc., plaintiff Jacob Keller alleged that UDR used RealPage pricing tools to set rents or occupancy levels at its San Diego properties after a city prohibition took effect on June 21, 2025. The complaint claims the tools relied on nonpublic competitor data and contributed to inflated rents for UDR tenants. UDR, a large publicly traded apartment owner and operator, had previously acknowledged using YieldStar in decisions concerning certain multifamily units.
Zoox Autonomous Vehicle Reportedly Entered Smoke-Obscured Fire Scene, Prompting Heavy-Smoke Detection Recall
On June 20, 2026, an unoccupied Zoox autonomous vehicle reportedly entered an active fire scene after heavy smoke obscured its surroundings. The purported automated driving system braked hard while attempting to steer away and stopped before the vehicle was reversed under teleguidance. Zoox later recalled 105 vehicles and issued a software update intended to improve detection of and response to heavy smoke.