AI Incidents
Real-world cases where AI systems caused harm, classified by risk domain and entity. Data sourced from 
AIID and classified by 
MIT AI Risk Initiative. CC BY-SA 4.0
538 incidents
South Korean Fraud Ring Allegedly Used Deepfake Identities to Traffic Victims into Cambodia Scam Operations
Authorities in Vietnam arrested three South Korean men alleged to have used purported deepfake identities in a cross-border romance scam scheme. Victims were reportedly deceived into travel and coerced into moving to Cambodia, where they reportedly were forced into performing scam operations after their passports were taken. The network allegedly obtained about USD $1 million in 2024 before the suspects fled Cambodia and were arrested in Da Nang on October 28, 2025.
Deepfake of Kamala Harris Saying Damaging Comments Circulates on X and Is Amplified by Elon Musk
The X user @MrReaganUSA uploaded a deepfake of Kamala Harris saying damaging comments about Joe Biden and her own qualifications for the presidency, originally marking it as a parody. The post was shared and amplified eight hours later via Elon Musk's account without the disclaimer.
Sichuan Province Beset by Numerous Fabricated AI-Generated Reports of Disasters and Crises
In Sichuan, AI tools were reportedly used to create and disseminate false reports across various cities, including fabricated stories of landslides, earthquakes, standoffs, accidents, and health-related incidents. These AI-driven rumors misled the public, caused alarm and confusion, and strained local authorities. The alleged perpetrators sought social media engagement and financial gain through clickbait content. The authorities in Sichuan ultimately levied administrative penalties against the perpetrators.
Purported AI-Generated Video Depicting Philippine President Ferdinand Marcos Jr. Using Drugs Shared by Rodrigo Duterte Supporters and Amplified by China-Linked Spamouflage
A purported deepfake video depicting Philippine President Ferdinand Marcos Jr. using drugs was released by Rodrigo Duterte ally Claire "Maharlika" Contreras at a Maisug rally in Los Angeles. The clip was reportedly timed to discredit Marcos ahead of his State of the Nation Address. Philippine authorities reportedly confirmed it was fake. The video was allegedly amplified by China's Spamouflage network via coordinated inauthentic accounts on X and YouTube.
Ferrari Executive Targeted by AI Deepfake Scam Impersonating CEO Benedetto Vigna
A Ferrari executive was targeted by an AI-generated deepfake impersonating CEO Benedetto Vigna in an alleged fraud attempt. The scammer, using WhatsApp and a cloned voice, claimed an urgent, secretive financial deal required immediate action. The executive became suspicious after detecting slight artificial intonations; the scam failed when the executive tested the caller by asking about a recent book recommendation.
Taranaki, New Zealand Resident Allegedly Defrauded of $224K in Bitcoin Scam Using Deepfake of Prime Minister Christopher Luxon
A Taranaki, New Zealand resident allegedly lost $224,000 in a Bitcoin scam involving a deepfake video reportedly depicting Prime Minister Christopher Luxon. The AI-generated video, shared on Facebook, purportedly promoted cryptocurrency investments targeting superannuitants. Scammers posing as financial advisers reportedly gained remote access to the victim’s computer and created accounts to facilitate the transfer of funds.
Suspect in Palisades Fire Allegedly Consulted ChatGPT for Arson Tips and Legal Advice Before Blaze That Killed 12 and Destroyed 6,837 Structures
Federal prosecutors allege that Jonathan Rinderknecht, arrested on 10/08/2025, consulted ChatGPT for arson-related imagery and legal advice before and after deliberately starting the Palisades fire in Los Angeles on 01/01/2025. The blaze, which reignited on 01/07/2025, killed 12 people and destroyed 6,873 buildings. Prosecutors say he generated a dystopian fire image with ChatGPT and later asked about liability for fires caused by cigarettes.
China Targets AI-Driven Fraud and Deepfake Scandals with New Crackdowns
Chinese law enforcement has targeted a rise in AI-driven crimes. The crimes include deepfake and voice synthesis used for fraud, identity theft, and unauthorized personality rights usage. In particular, "AI undressing" scams, fake relationships using synthesized voices, and game hacking software make up many of these cases. In response, authorities have prosecuted multiple cases and implemented stricter regulations to control AI misuse.
Purported Deepfake Targets Olena Zelenska in Alleged Russian Disinformation Campaign
A purported deepfake video falsely suggesting that Olena Zelenska, wife of Ukrainian President Volodymyr Zelenskyy, purchased a luxury car, reportedly circulated widely online. The video is reportedly part of a Russian-linked disinformation campaign aimed at undermining Ukraine and its supporters.
Female Politicians in the United Kingdom Reportedly Victimized by Purported Deepfake Pornography
Female politicians in the United Kingdom, including Angela Rayner, Gillian Keegan, Penny Mordaunt, Priti Patel, Stella Creasy, and Dehenna Davison, have reportedly been targeted by non-consensual, purportedly AI-generated deepfake pornography. The images, which some accounts suggest may have circulated online for an extended period, were reported to have caused distress and, in at least some instances, to have prompted reports to or involvement by law enforcement.
AllHere's Chatbot 'Ed' Fails and Costs Los Angeles Unified School District $6 Million
The Los Angeles Unified School District invested up to $6 million in developing the AI chatbot "Ed," meant to provide academic and mental health support for students. The chatbot allegedly failed to meet expectations, and the project collapsed when AllHere, the contracted start-up, faced financial difficulties. Prince George's County Public Schools in Maryland was also affected. Founder Joanna Smith-Griffin was removed as CEO in June 2024 and later arrested on fraud charges.
Scammers Allegedly Use Deepfake Technology to Pose as Leonor, Princess of Asturias, in Fraud Scheme
Scammers have allegedly been using deepfake technology and fake social media accounts to reportedly impersonate Leonor, Princess of Asturias, targeting vulnerable individuals in Latin America. Victims were reportedly lured with promises of financial aid, requiring payments for "fees" or "taxes" before receiving funds, only to allegedly be defrauded repeatedly. TikTok accounts with thousands of followers reportedly amplified the scheme using AI to increase the appearance of credibility.
Scammers Allegedly Use Deepfake of Hong Kong Entertainer Andy Lau to Steal NT$2.64 Million from Fan
Scammers allegedly defrauded a woman in New Taipei City of NT$2.64 million (US$81,116) by impersonating Hong Kong entertainer Andy Lau using purported deepfakes. The alleged scam convinced the victim, a long-time fan, through a video call that "Lau" needed funds for a visit to Taiwan. The victim reportedly wired the money, but her family suspected a scam and involved the police. An alleged scammer was arrested after attempting to collect a staged cash payment.
AI-Enabled Fraud Schemes Reportedly Increasing Consumer Harm and Challenging Detection
Scammers are reportedly using AI tools such as language models, voice cloning, and synthetic IDs to create more convincing frauds, leading to financial losses and identity theft. Banks have begun deploying AI-driven verification tools to counter these schemes, but experts warn that AI-enabled fraud continues to cause real-world harm and remains difficult to detect.
Senior Minister of Singapore Lee Hsien Loong Allegedly Misrepresented in Two Deepfake Videos on Foreign Relations
Two deepfake videos falsely depicted Senior Minister of Singapore Lee Hsien Loong commenting on US-China relations and the South China Sea. The videos misleadingly attributed views to him and the Singapore government. Posted on TikTok, the videos amassed over 190,000 views before being removed.