AI Incidents
Real-world cases where AI systems caused harm, classified by risk domain and entity. Data sourced from
AIID and classified by MIT AI Risk Initiative. CC BY-SA 4.0
526 incidents
Unlabeled Purportedly AI-Generated 'Jessica Foster' Account Reportedly Posed as Pro-Trump Army Service Member to Attract Followers and Funnel Users to Paid Adult Content
"Jessica Foster" (@jessicaa.foster) reportedly operated as an AI-generated deception Instagram profile. A nonexistent pro-Trump military persona was presented through purportedly synthetic photos and videos without disclosure, reportedly attracting a large audience of users who often seemed to believe she was real. The account allegedly then redirected attention to paid adult-content platforms. Meta later removed the profile.
Purported Deepfake-Based Facebook Impersonation Reportedly Targets Daughter of Scot in Coma
Scammers allegedly created a fake Facebook profile impersonating a Scottish woman, Teigan McMahon, raising funds for her father, who was reportedly in a coma in Turkey. The account reportedly reused her photos and posts and was described as using purportedly AI-generated or deepfake-style content to solicit donations. The impersonation forced the family to pause their legitimate fundraiser while the fake profile remained online.
Facebook Account Reportedly Used AI-Generated Video to Impersonate Indonesian Preacher Ustaz Ujang Bustomi in Money-Giveaway Scam
A Facebook account called "PT perusahaan uangtunai" reportedly shared an AI-generated video impersonating Indonesian preacher Ustaz Ujang Bustomi and allegedly claiming he was giving away money. TurnBackHoax reported that the post drew about 12,500 likes, 7,100 comments, and 422 shares by 11/21/2025, and that Hive Moderation rated the video as likely AI-generated.
Secret Desires AI Platform Reportedly Exposed Nearly Two Million Sensitive Images in Cloud Storage Leak
The erotic AI chatbot and image-generation platform Secret Desires reportedly left nearly two million sensitive images and videos publicly exposed in misconfigured cloud storage. The leaked files reportedly included personal photos, workplace and university information, and explicit AI-generated deepfakes of women and girls. The content reportedly became inaccessible shortly after journalists contacted the platform.
Purportedly AI-Enhanced Phishing Campaign Allegedly Impersonates Australian Government Services in Large-Scale Welfare Scam
A large-scale phishing campaign allegedly impersonating Services Australia and Centrelink reportedly sent more than 270,000 fraudulent emails in 2025. Mimecast analysts reportedly say attackers (designated MCTO3001) used AI tools to generate highly convincing government-themed messages and evasion techniques, targeting vulnerable Australians and public institutions. Victims reportedly faced risks of credential theft and downstream digital exploitation.
Reported Disqualification of Two Books from the Ockham New Zealand Book Awards Due to Alleged AI-Generated Cover Art
Organizers of the Ockham New Zealand Book Awards reportedly disqualified two fiction books after it was reportedly determined their cover illustrations were produced using AI-assisted tools, rendering the works ineligible under newly introduced award criteria. The publisher reportedly confirmed AI involvement in the jacket designs. The authors were not implicated in the artwork decisions but were nonetheless removed from consideration for the 2026 running.
Purported Deepfake of Greek Finance Minister Kyriakos Pierrakakis Reportedly Used in Facebook Investment Scam
Greek Finance Minister Kyriakos Pierrakakis and the Ministry of Economy and Finance reportedly filed a lawsuit against unidentified operators of a Facebook page that allegedly used AI to generate a deepfake video falsely depicting the minister endorsing fraudulent "high-yield" investment schemes. Authorities noted this follows similar deepfake-driven scams in Greece involving impersonation of public figures for illicit financial gain.
Chinese State-Linked Operator (GTG-1002) Reportedly Uses Claude Code for Autonomous Cyber Espionage
Anthropic reportedly identified a cyber espionage campaign in which a purported Chinese state-linked group, designated GTG-1002 by Anthropic, allegedly jailbroke Claude Code and used it to automate 80–90% of multi-stage intrusions. The AI reportedly independently performed reconnaissance, vulnerability discovery, exploitation, credential harvesting, and data extraction across roughly 30 targets before the activity was detected and blocked.
Rep. Mike Collins's Campaign Allegedly Produced Deepfake of Sen. Jon Ossoff Supporting the Government Shutdown
Rep. Mike Collins's congressional campaign allegedly created and posted an AI-generated video that purportedly used Sen. Jon Ossoff's portrait and synthetic voice to falsely depict him supporting the ongoing government shutdown. The video was reportedly shared on the campaign's X account with a limited disclaimer. Georgia Democrats criticized the deepfake as misleading, and the campaign reportedly indicated it would continue using similar AI tactics.
Purportedly AI-Generated Sexual Images of At Least 400 Minors at Zacatecas School Were Reportedly Created and Sold Online
A student at Escuela Secundaria Técnica No. 1 in Zacatecas, Mexico, allegedly used an AI image-generation system to create sexually explicit manipulated images of classmates. According to victims and parents, the student reportedly produced a catalog containing images of more than 400 minors, organized by grade and group, and distributed or sold the material online. Students reported that the perpetrator took photos around the school to use as inputs. The Fiscalía de Zacatecas opened an investigation for crimes against sexual privacy and offered psychological and legal support to victims. The manipulated images are reportedly believed to have circulated beyond the school.
Balázs Orbán Allegedly Published Purported Deepfake of Péter Magyar Claiming He Would Cut Pensions
In Hungary, opposition leader Péter Magyar alleged that Viktor Orbán aide Balázs Orbán published an unlabeled deepfake video on Facebook reportedly depicting Magyar as saying he would cut and tax pensions ahead of the 2026 parliamentary election. Magyar reportedly said he would file a criminal complaint and described the video as defamatory.
Alleged Fabricated News Sites and Deepfakes Impersonated Maltese Ministers, Financial Experts, and Media to Promote NethertoxAGENT Fraud
Purportedly AI-generated deepfake videos and fabricated news pages impersonating Maltese ministers, journalists, financial experts, and major media outlets reportedly promoted the fraudulent "NethertoxAGENT" investment platform. The scam used synthetic interviews, cloned branding, and falsified testimonials to mislead social media users, reportedly inducing financial losses and prompting law enforcement concern in Malta.
Purportedly AI-Generated Fake Videos of Louvre Heist Reportedly Circulated Widely Online
After the October 19, 2025 jewel heist at the Louvre, purported deepfakes were reported to have circulated widely online, allegedly depicting the robbery despite being fabricated.. The clips were reportedly posted on Facebook, Douyin and RedNote, and they were noted to have featured morphing artifacts, disappearing objects, and partial Sora watermarks. AI Forensics and independent checks reportedly found the scenes inconsistent with the real Apollo Gallery, confirming the footage was not real.
Purportedly AI-Generated Deepfake Investment Ads Defrauded 5,000 Swedish Investors of 500 Million SEK
At least 5,000 Swedish investors were reportedly defrauded of around 500 million SEK (~$52.5 million USD) in 2025 through purportedly AI-generated deepfake investment ads circulated on Meta platforms. Fraudsters allegedly used fabricated videos and profiles of well-known finance figures such as journalist Gabriel Mellqvist and investor Günter Mårder to promote false stock tips in pump-and-dump schemes.
AI Training Dataset for Detecting Nudity Allegedly Found to Contain CSAM Images of Identified Victims
An image dataset, NudeNet, used to train systems for detecting nudity was reportedly found to contain CSAM images, including material involving identified or known victims. According to the Canadian Centre for Child Protection, the dataset had been widely downloaded and cited in academic research prior to discovery. The images were allegedly included without vetting, exposing researchers to legal risk and perpetuating harm to victims. The dataset was subsequently removed following notification.