AI Incidents
Real-world cases where AI systems caused harm, classified by risk domain and entity. Data sourced from
AIID and classified by MIT AI Risk Initiative. CC BY-SA 4.0
464 incidents
Video with Reportedly AI-Generated Media Purported to Show Croatian Neurosurgeon Josip Paladino Endorsing Steplex in Fake TV Segment on Facebook
A Facebook page reportedly posted a video styled as a TV news segment that purported to show Croatian neurosurgeon Josip Paladino endorsing a pain-treatment product called Steplex after an on-air assault. The clip was reported to use AI-generated or manipulated media built from older footage, and the ad linked users to a page mimicking Croatia's Ministry of Health while soliciting purchases and contact data.
Elon Musk Reportedly Shared an AI-Generated Image Depicting Kamala Harris Dressed as a Communist Ruler
Elon Musk reportedly shared an AI-generated image on X depicting Kamala Harris as a "communist dictator" in response to her post about Donald Trump's political intentions.
Bias in AI Deepfake Detection Undermines Election Security in Global South
AI deepfake detection tools are reportedly failing voters in the Global South due to biases in their training data. These tools, which prioritize English language and Western faces, show reduced accuracy when detecting manipulated content from non-Western regions. As a result of this detection gap, election integrity faces threats from and the amplification of misinformation, which leaves journalists and researchers with inadequate resources to combat the issue.
AkiraBot Reportedly Used OpenAI to Spam Website Chats and Contact Forms at Scale
SentinelLabs reported that unknown operators used AkiraBot, a Python framework, plus OpenAI's chat API to generate customized SEO spam and bypass CAPTCHAs, posting via SMB websites' contact forms and Reamaze-style chat widgets. Researchers assessed >400k domains were targeted and ≥80k successfully spammed since 09/01/2024. OpenAI said the API key was disabled after disclosure.
Video with Reportedly AI-Generated Media Purported to Show Croatian Immunologist Stipan Jonjić Promoting Anti-Parasite Product on Facebook
A Facebook page reportedly posted a video that purported to show Croatian immunologist Stipan Jonjić endorsing an anti-parasite product and recommending it over conventional treatment. The clip was reported to use AI-generated or manipulated media, and Jonjić denied involvement. A woman was reported to have purchased the product after seeing the ad.
Joint Base Elmendorf-Richardson Soldier Faces Allegations of Using AI to Generate Child Pornography
Seth Herrera, a U.S. Army soldier at Joint Base Elmendorf-Richardson (JBER), is accused of using artificial intelligence to generate pornography depicting minors with whom he was in contact.
AI Image of Kamala Harris at DNC with Communist Flags Circulated by Trump
Donald Trump shared an AI-generated image on social media that falsely depicted Kamala Harris speaking at a DNC event surrounded by communist imagery including the hammer and sickle of the Soviet Union. The image was intended to undermine Harris ahead of the Democratic National Convention and to suggest that her views are aligned with communism.
TikTok AI System Used to Amplify Election Disinformation by Foreign Networks
AI-generated misinformation on TikTok, driven by foreign networks, has flooded the platform with false narratives about the 2024 U.S. presidential election. Thousands of videos spreading political lies were identified, potentially influencing millions of users. Despite TikTok’s efforts to remove these accounts, the AI-driven disinformation campaign continues to challenge the integrity of the election.
Purportedly AI-Manipulated Synthetic Media Allegedly Fuels False Reports of Natural Disasters and Accidents in China
In China, purported AI tools were reportedly used to fabricate and disseminate false reports of disasters, including a landslide in Yunnan, an earthquake in Sichuan, and a sudden death after a traffic incident. On May 27, 2024, a real 5.0-magnitude earthquake occurred in Muli County, Sichuan, with no casualties and limited property damage. However, a social media post later falsely claimed the epicenter was in Xide County and exaggerated the event's severity, adding fabricated images of extensive destruction. The deployers of these false reports have since received administrative penalties from Chinese authorities for their actions.
Norwegian Student Reportedly Used AI-Generated Deepfake Videos in Spanish Coursework at University of South-Eastern Norway
A student at the University of South-Eastern Norway reportedly submitted multiple deepfake videos for Spanish coursework, featuring an AI-generated likeness and synthetic voice. Faculty reportedly noted unnatural facial movements and inconsistent language ability. The case was reportedly ruled academic misconduct, resulting in annulled grades and a year-long suspension, marking one of Norway's first confirmed deepfake-related cheating cases.
South Korean Fraud Ring Allegedly Used Deepfake Identities to Traffic Victims into Cambodia Scam Operations
Authorities in Vietnam arrested three South Korean men alleged to have used purported deepfake identities in a cross-border romance scam scheme. Victims were reportedly deceived into travel and coerced into moving to Cambodia, where they reportedly were forced into performing scam operations after their passports were taken. The network allegedly obtained about USD $1 million in 2024 before the suspects fled Cambodia and were arrested in Da Nang on October 28, 2025.
Deepfake of Kamala Harris Saying Damaging Comments Circulates on X and Is Amplified by Elon Musk
The X user @MrReaganUSA uploaded a deepfake of Kamala Harris saying damaging comments about Joe Biden and her own qualifications for the presidency, originally marking it as a parody. The post was shared and amplified eight hours later via Elon Musk's account without the disclaimer.
Sichuan Province Beset by Numerous Fabricated AI-Generated Reports of Disasters and Crises
In Sichuan, AI tools were reportedly used to create and disseminate false reports across various cities, including fabricated stories of landslides, earthquakes, standoffs, accidents, and health-related incidents. These AI-driven rumors misled the public, caused alarm and confusion, and strained local authorities. The alleged perpetrators sought social media engagement and financial gain through clickbait content. The authorities in Sichuan ultimately levied administrative penalties against the perpetrators.
Purported AI-Generated Video Depicting Philippine President Ferdinand Marcos Jr. Using Drugs Shared by Rodrigo Duterte Supporters and Amplified by China-Linked Spamouflage
A purported deepfake video depicting Philippine President Ferdinand Marcos Jr. using drugs was released by Rodrigo Duterte ally Claire "Maharlika" Contreras at a Maisug rally in Los Angeles. The clip was reportedly timed to discredit Marcos ahead of his State of the Nation Address. Philippine authorities reportedly confirmed it was fake. The video was allegedly amplified by China's Spamouflage network via coordinated inauthentic accounts on X and YouTube.
Ferrari Executive Targeted by AI Deepfake Scam Impersonating CEO Benedetto Vigna
A Ferrari executive was targeted by an AI-generated deepfake impersonating CEO Benedetto Vigna in an alleged fraud attempt. The scammer, using WhatsApp and a cloned voice, claimed an urgent, secretive financial deal required immediate action. The executive became suspicious after detecting slight artificial intonations; the scam failed when the executive tested the caller by asking about a recent book recommendation.