AI Incidents
Real-world cases where AI systems caused harm, classified by risk domain and entity. Data sourced from 
AIID and classified by 
MIT AI Risk Initiative. CC BY-SA 4.0
526 incidents
Criminal Group Uses AI Deepfake Technology to Steal Personal Data in Hangzhou, Zhejiang
A criminal group in China used AI face-swapping technology to bypass face recognition systems on major platforms, steal personal data, and sell it to fraud syndicates. The group generated convincing video simulations from static photos to breach accounts, reportedly earning 200,000 yuan. After an investigation by the Hangzhou Public Security Bureau, four suspects were arrested across the provinces of Anhui, Guizhou, and Zhejiang.
AI 'Nudify' Apps Used as Tools for Blackmail and Extortion
AI 'nudify' apps are being used to generate hyperrealistic non-consensual nude photos of individuals, which are then exploited for extortion and harassment. These apps use generative AI to remove clothing from images and create convincing fakes, often distributed on platforms like Telegram. Victims are threatened or shamed using these AI-generated images, with little recourse for removal or legal action.
Music Producer Michael Smith Reportedly Arrested for Allegedly Using AI-Generated Songs in $10 Million Streaming Scam
Music producer Michael Smith was reportedly arrested for allegedly using AI-generated songs and fake streaming accounts to scam over $10 million in royalties from major music platforms. By purportedly creating hundreds of thousands of songs and employing bots to artificially inflate streams, Smith reportedly circumvented fraud detection systems. The scheme was reportedly exposed after suspicions arose regarding the rapid generation of music and streaming anomalies.
Video with Reportedly AI-Generated Media Purported to Show Croatian Neurosurgeon Josip Paladino Endorsing Steplex in Fake TV Segment on Facebook
A Facebook page reportedly posted a video styled as a TV news segment that purported to show Croatian neurosurgeon Josip Paladino endorsing a pain-treatment product called Steplex after an on-air assault. The clip was reported to use AI-generated or manipulated media built from older footage, and the ad linked users to a page mimicking Croatia's Ministry of Health while soliciting purchases and contact data.
Elon Musk Reportedly Shared an AI-Generated Image Depicting Kamala Harris Dressed as a Communist Ruler
Elon Musk reportedly shared an AI-generated image on X depicting Kamala Harris as a "communist dictator" in response to her post about Donald Trump's political intentions.
Bias in AI Deepfake Detection Undermines Election Security in Global South
AI deepfake detection tools are reportedly failing voters in the Global South due to biases in their training data. These tools, which prioritize English language and Western faces, show reduced accuracy when detecting manipulated content from non-Western regions. As a result of this detection gap, election integrity faces threats from and the amplification of misinformation, which leaves journalists and researchers with inadequate resources to combat the issue.
AkiraBot Reportedly Used OpenAI to Spam Website Chats and Contact Forms at Scale
SentinelLabs reported that unknown operators used AkiraBot, a Python framework, plus OpenAI's chat API to generate customized SEO spam and bypass CAPTCHAs, posting via SMB websites' contact forms and Reamaze-style chat widgets. Researchers assessed >400k domains were targeted and ≥80k successfully spammed since 09/01/2024. OpenAI said the API key was disabled after disclosure.
Video with Reportedly AI-Generated Media Purported to Show Croatian Immunologist Stipan Jonjić Promoting Anti-Parasite Product on Facebook
A Facebook page reportedly posted a video that purported to show Croatian immunologist Stipan Jonjić endorsing an anti-parasite product and recommending it over conventional treatment. The clip was reported to use AI-generated or manipulated media, and Jonjić denied involvement. A woman was reported to have purchased the product after seeing the ad.
Joint Base Elmendorf-Richardson Soldier Faces Allegations of Using AI to Generate Child Pornography
Seth Herrera, a U.S. Army soldier at Joint Base Elmendorf-Richardson (JBER), is accused of using artificial intelligence to generate pornography depicting minors with whom he was in contact.
AI Image of Kamala Harris at DNC with Communist Flags Circulated by Trump
Donald Trump shared an AI-generated image on social media that falsely depicted Kamala Harris speaking at a DNC event surrounded by communist imagery including the hammer and sickle of the Soviet Union. The image was intended to undermine Harris ahead of the Democratic National Convention and to suggest that her views are aligned with communism.
TikTok AI System Used to Amplify Election Disinformation by Foreign Networks
AI-generated misinformation on TikTok, driven by foreign networks, has flooded the platform with false narratives about the 2024 U.S. presidential election. Thousands of videos spreading political lies were identified, potentially influencing millions of users. Despite TikTok’s efforts to remove these accounts, the AI-driven disinformation campaign continues to challenge the integrity of the election.
Purportedly AI-Manipulated Synthetic Media Allegedly Fuels False Reports of Natural Disasters and Accidents in China
In China, purported AI tools were reportedly used to fabricate and disseminate false reports of disasters, including a landslide in Yunnan, an earthquake in Sichuan, and a sudden death after a traffic incident. On May 27, 2024, a real 5.0-magnitude earthquake occurred in Muli County, Sichuan, with no casualties and limited property damage. However, a social media post later falsely claimed the epicenter was in Xide County and exaggerated the event's severity, adding fabricated images of extensive destruction. The deployers of these false reports have since received administrative penalties from Chinese authorities for their actions.
Norwegian Student Reportedly Used AI-Generated Deepfake Videos in Spanish Coursework at University of South-Eastern Norway
A student at the University of South-Eastern Norway reportedly submitted multiple deepfake videos for Spanish coursework, featuring an AI-generated likeness and synthetic voice. Faculty reportedly noted unnatural facial movements and inconsistent language ability. The case was reportedly ruled academic misconduct, resulting in annulled grades and a year-long suspension, marking one of Norway's first confirmed deepfake-related cheating cases.
South Korean Fraud Ring Allegedly Used Deepfake Identities to Traffic Victims into Cambodia Scam Operations
Authorities in Vietnam arrested three South Korean men alleged to have used purported deepfake identities in a cross-border romance scam scheme. Victims were reportedly deceived into travel and coerced into moving to Cambodia, where they reportedly were forced into performing scam operations after their passports were taken. The network allegedly obtained about USD $1 million in 2024 before the suspects fled Cambodia and were arrested in Da Nang on October 28, 2025.
Deepfake of Kamala Harris Saying Damaging Comments Circulates on X and Is Amplified by Elon Musk
The X user @MrReaganUSA uploaded a deepfake of Kamala Harris saying damaging comments about Joe Biden and her own qualifications for the presidency, originally marking it as a parody. The post was shared and amplified eight hours later via Elon Musk's account without the disclaimer.