AI Incidents
Real-world cases where AI systems caused harm, classified by risk domain and entity. Data sourced from 
AIID and classified by 
MIT AI Risk Initiative. CC BY-SA 4.0
538 incidents
North Korea's Kimsuky Group Reportedly Uses AI-Generated Military ID Deepfakes in Phishing Campaign
Genians reported a phishing campaign by North Korea's Kimsuky group using purportedly AI-generated deepfake military ID cards. Emails reportedly impersonating South Korean defense institutions carried ZIP files with forged IDs whose photos were reportedly created using generative AI. When opened, hidden malware reportedly executed, downloading scripts disguised as Hancom Office updates. This reportedly marked an evolution in Kimsuky's tactics, using AI decoys to boost social engineering.
Purported Deepfake Videos Allegedly Impersonated Optometrist Joseph Allen to Promote Myopia-Reversal Eyedrops on TikTok
Optometrist and online educator Joseph Allen ("Dr. Eye Health") reported that AI-generated videos using his likeness and voice were circulated on TikTok to promote eyedrops purportedly claiming to reverse myopia. The alleged scam misrepresented Allen's views and discouraged visits to eye-care professionals. They reportedly resurfaced after a takedown.
Purportedly AI-Generated Videos Impersonate Brunei Police in 'Real Money Magic' Scam on Social Media
The Royal Brunei Police Force issued a public warning about purportedly AI-generated deepfake videos impersonating police officers on TikTok, Facebook, and Instagram. The videos allegedly promote a fraudulent investment scheme known as "Real Money Magic," reportedly claiming guaranteed financial returns. Authorities report that scammers use synthetic video and audio to gain victims' trust and induce money transfers. The scam has not been linked to any official institutions.
Azerbaijani Media Agency Reportedly Warned Purported Deepfake Videos Attributed to Defense and Foreign Ministers Claimed Belarusian Plane Was Downed in Russian Airspace
Azerbaijan's Media Development Agency reported that purportedly AI-generated deepfake videos circulated on social media appearing to show statements by Azerbaijan's defense and foreign ministers (Zakir Hasanov and Jeyhun Bayramov, respectively) about the alleged downing of a Belarusian aircraft in Russian airspace. The agency reportedly denied the videos were authentic and called them an information manipulation effort aimed at misleading public opinion.
Purported Deepfake Scam Videos Depict JG Summit Holdings President and CEO Lance Gokongwei Allegedly Endorsing Illicit Investments
The Securities and Exchange Commission of the Philippines reportedly warned of deepfake scam videos and audio purportedly depicting Lance Gokongwei, President and CEO of JG Summit Holdings, endorsing fraudulent crypto and forex investments. Victims are reportedly tricked into entering credit card details and OTPs on a platform allegedly based in Cyprus.
LAMEHUG Malware Reportedly Integrates Large Language Model for Real-Time Command Generation in a Purported APT28-Linked Cyberattack
Ukraine's CERT-UA and Cato CTRL reported LAMEHUG, the first known malware to integrate a large language model (Qwen2.5-Coder-32B-Instruct via Hugging Face) for real-time command generation. Attributed with moderate confidence to APT28 (Fancy Bear), the malware reportedly targeted Ukrainian officials through phishing emails. The LLM is reported to have dynamically generated reconnaissance and data-exfiltration commands executed on infected systems.
Purportedly AI-Cloned Voice of Daughter Used in Elaborate Bond Scam Targeting Retired Couple in Hillsborough County, Florida
A Hillsborough County, Florida, woman was reportedly defrauded of $15,000 in an alleged AI-enabled scam. The perpetrators are reportedly said to have used an AI-generated voice clone of the woman's daughter to impersonate her during a phone call and demand bond money.
Chicago Veteran Reportedly Loses $10,000 in Purported Deepfake Cryptocurrency Fraud Posing as Elon Musk
A Chicago-area Vietnam War veteran, Richard Lyons, reportedly lost $10,000 to a cryptocurrency scam that used purported AI voice cloning and fake social media profiles to impersonate Elon Musk. The fraudster allegedly convinced Lyons to invest in bogus cryptocurrency opportunities using fake voice memos, images, and spoofed caller IDs showing "Elon Musk." The scam reportedly involved dozens of messages and deepfake audio files that reinforced the impersonation.
Purported Deepfake Video of Donald Trump at NATO Summit Allegedly Used in YouTube Crypto Scam
Multiple YouTube Live streams reportedly featured a purported AI‑generated deepfake video depicting U.S. President Donald Trump at a NATO Summit press event. In the video, Trump reportedly appears to promote a Bitcoin "double-your-money" offer, directing viewers to scan an on‑screen QR code and send cryptocurrency to a specified address. The video was reportedly not authentic and is alleged to have been part of an ongoing YouTube-based crypto scam campaign.
Purported Widespread Use of AI-Generated Deepfake Videos Impersonate Malaysian Leaders in Investment Scams
Purported AI-generated deepfake videos depicting Malaysia's Prime Minister Anwar Ibrahim and other officials, political leaders, and business leaders have reportedly been used to promote fraudulent investment schemes. A total of 13,956 cases were reported last year, with RM2.11 billion allegedly lost to these scams. Victims were allegedly misled by hyper-realistic fake endorsements circulated via Facebook, WhatsApp, and Telegram. Scammers allegedly adapt quickly, generating new deepfakes when content is removed.
Delhi Man Reportedly Arrested for Sharing Purportedly AI-Morphed Obscene Images of Ex-Girlfriend
A 21-year-old man in Delhi was reportedly arrested for allegedly using AI morphing tools to create obscene images of his ex-girlfriend and distributing them through fake Instagram accounts. Police said he impersonated her, used real photos, and targeted her followers to harass and defame her after their breakup. The accused evaded detection by reportedly using multiple unverified Instagram handles.
Preprints Reportedly from Researchers from Multiple Universities Allegedly Contain Covert AI Prompts
Hidden prompts reportedly were discovered in at least 17 academic preprints on arXiv that purportedly instructed AI tools to deliver only positive peer reviews. The lead authors are reportedly affiliated with 14 institutions in eight countries, including Waseda University, KAIST, Peking University, and the University of Washington. The alleged concealed instructions, some of which were reportedly embedded using white text or tiny fonts, were purportedly intended to influence any reviewers who rely on AI tools.
Chinese-Backed Operation Reportedly Used AI-Generated Deepfake Videos of Indian Stock Experts in Investment Fraud Campaign
Mumbai Cyber Police reportedly uncovered a coordinated investment fraud campaign that used purported deepfake videos of Indian stock market experts to mislead investors. Between July 1 and July 18, 2025, the videos reportedly circulated on social media as paid promotions by a Bengaluru-based firm, Valueleaf, allegedly contracted by a Hong Kong company, First Bridge. Four individuals were arrested.
Alleged Unauthorized Deepfake AI Clones of Ravish Kumar Used to Spread Purportedly Fabricated News on YouTube
Prominent Indian journalist Ravish Kumar reported that multiple YouTube channels are using purported deepfakes to mimic his face and voice, spreading fabricated and nonsensical news in his name. Kumar warned viewers not to trust these channels, filed complaints with YouTube, and is awaiting action.
Reported AI-Generated Audio of Ukrainian Commander Andriy Biletsky Used in Russian Disinformation Campaign
In late June 2025, Russian Telegram channels reportedly circulated a video containing a purportedly AI-generated audio track impersonating Ukrainian commander Andrii Biletskyi. The audio clip reportedly claimed Ukrainian authorities deliberately avoid identifying fallen soldiers to withhold compensation. Verification reportedly showed the voice was synthetic and mismatched with original May 16 footage of Biletskyi. Hive Moderation reportedly confirmed the audio was overwhelmingly AI-generated.