AI Incidents
Real-world cases where AI systems caused harm, classified by risk domain and entity. Data sourced from
AIID and classified by MIT AI Risk Initiative. CC BY-SA 4.0
464 incidents
Suspect in Palisades Fire Allegedly Consulted ChatGPT for Arson Tips and Legal Advice Before Blaze That Killed 12 and Destroyed 6,837 Structures
Federal prosecutors allege that Jonathan Rinderknecht, arrested on 10/08/2025, consulted ChatGPT for arson-related imagery and legal advice before and after deliberately starting the Palisades fire in Los Angeles on 01/01/2025. The blaze, which reignited on 01/07/2025, killed 12 people and destroyed 6,873 buildings. Prosecutors say he generated a dystopian fire image with ChatGPT and later asked about liability for fires caused by cigarettes.
China Targets AI-Driven Fraud and Deepfake Scandals with New Crackdowns
Chinese law enforcement has targeted a rise in AI-driven crimes. The crimes include deepfake and voice synthesis used for fraud, identity theft, and unauthorized personality rights usage. In particular, "AI undressing" scams, fake relationships using synthesized voices, and game hacking software make up many of these cases. In response, authorities have prosecuted multiple cases and implemented stricter regulations to control AI misuse.
Purported Deepfake Targets Olena Zelenska in Alleged Russian Disinformation Campaign
A purported deepfake video falsely suggesting that Olena Zelenska, wife of Ukrainian President Volodymyr Zelenskyy, purchased a luxury car, reportedly circulated widely online. The video is reportedly part of a Russian-linked disinformation campaign aimed at undermining Ukraine and its supporters.
AllHere's Chatbot 'Ed' Fails and Costs Los Angeles Unified School District $6 Million
The Los Angeles Unified School District invested up to $6 million in developing the AI chatbot "Ed," meant to provide academic and mental health support for students. The chatbot allegedly failed to meet expectations, and the project collapsed when AllHere, the contracted start-up, faced financial difficulties. Prince George's County Public Schools in Maryland was also affected. Founder Joanna Smith-Griffin was removed as CEO in June 2024 and later arrested on fraud charges.
Scammers Allegedly Use Deepfake Technology to Pose as Leonor, Princess of Asturias, in Fraud Scheme
Scammers have allegedly been using deepfake technology and fake social media accounts to reportedly impersonate Leonor, Princess of Asturias, targeting vulnerable individuals in Latin America. Victims were reportedly lured with promises of financial aid, requiring payments for "fees" or "taxes" before receiving funds, only to allegedly be defrauded repeatedly. TikTok accounts with thousands of followers reportedly amplified the scheme using AI to increase the appearance of credibility.
Scammers Allegedly Use Deepfake of Hong Kong Entertainer Andy Lau to Steal NT$2.64 Million from Fan
Scammers allegedly defrauded a woman in New Taipei City of NT$2.64 million (US$81,116) by impersonating Hong Kong entertainer Andy Lau using purported deepfakes. The alleged scam convinced the victim, a long-time fan, through a video call that "Lau" needed funds for a visit to Taiwan. The victim reportedly wired the money, but her family suspected a scam and involved the police. An alleged scammer was arrested after attempting to collect a staged cash payment.
Cody Enterprise Reporter Resigns After Admitting to AI-Generated Fake Quotes
A reporter at the Cody Enterprise used AI to generate fake quotes and stories, including fabricating statements from Wyoming’s governor and other officials. The misuse of AI was uncovered when another journalist noticed robotic phrases and false information in the articles. The reporter resigned, and the newspaper is now implementing policies to prevent future incidents.
AI-Enabled Fraud Schemes Reportedly Increasing Consumer Harm and Challenging Detection
Scammers are reportedly using AI tools such as language models, voice cloning, and synthetic IDs to create more convincing frauds, leading to financial losses and identity theft. Banks have begun deploying AI-driven verification tools to counter these schemes, but experts warn that AI-enabled fraud continues to cause real-world harm and remains difficult to detect.
Turkish Student in Isparta Allegedly Uses AI to Cheat on Exam, Leading to Arrest
A Turkish student in Isparta was reportedly arrested for using ChatGPT to cheat during the 2024 YKS university entrance exam. The student, identified as M.E.E., is alleged to have employed a sophisticated setup involving a router, mobile phone, earphone, and a button-shaped camera to transmit exam questions to ChatGPT and receive answers in real-time.
Teenager Reportedly Makes Deepfake Pornography of 50 Girls at Bacchus Marsh Grammar School in Australia
At Bacchus Marsh Grammar, a school in Victoria state in Australia, an adolescent male reportedly made deepfake pornography of 50 girls, ages 9 to 12. He then allegedly uploaded the pictures to Instagram, and others subsequently shared them on Snapchat.
xAI Allegedly Operates Unpermitted Methane Turbines in Memphis to Power Supercomputer Colossus to Train Grok
The xAI "Colossus" supercomputer facility in South Memphis allegedly runs 33 methane-powered turbines, despite a permit for only 15. The turbines reportedly power AI training for Grok. The facility's massive energy use and alleged unpermitted turbines reportedly produce extreme nitrogen oxide and formaldehyde emissions, adding toxic smog to a predominantly Black neighborhood already burdened by pollution and health risks.
Hoodline Accused of Misleadingly Attributing AI-Generated Articles to Human Authors
In 2023, the news site Hoodline is reported to have begun publishing AI-generated articles with fake bylines, headshots, and biographies, allegedly misleading readers into believing they were authored by real journalists. This practice diminishes public trust and exemplifies the potential dangers of AI in journalism. Despite a disclaimer, the use of AI was not transparent.
Covert AI Influence Operations Linked to Russia, China, Iran, and Israel, OpenAI Reports
In a report released by OpenAI, the company described how its generative AI tools were misused by state actors and private companies in Russia, China, Iran, and Israel to conduct covert influence campaigns aimed at manipulating public opinion and geopolitical narratives.
American Asylum Seeker John Mark Dougan in Russia Reportedly Spreads Disinformation via AI Tools and Fake News Network
John Mark Dougan, a former Florida sheriff's deputy granted asylum in Russia, has been implicated in spreading disinformation. Utilizing AI tools like OpenAI's ChatGPT and DALL-E 3, Dougan created over 160 fake news sites, disseminating false narratives to millions worldwide. His actions align with Russian disinformation strategies targeting Western democracies. See also Incident 734.
Reportedly Hacked AI-Powered Robot Vacuums Allegedly Used for Surveillance and Harassment
Hackers reportedly exploited a vulnerability in Ecovacs’s Deebot X2 robot vacuums, gaining unauthorized access to camera and microphone controls. Users reported privacy invasions and offensive language broadcasted through the devices. Although Ecovacs claimed to have resolved the security flaw, researchers suggest vulnerabilities remain that could potentially leave users exposed to surveillance and harassment through their AI-enabled devices.