AI Incidents
Real-world cases where AI systems caused harm, classified by risk domain and entity. Data sourced from
AIID and classified by MIT AI Risk Initiative. CC BY-SA 4.0
464 incidents
Purported Deepfake Video and Fake News Articles Allegedly Used to Impersonate Guernsey's Chief Minister in Investment Scam
Scammers allegedly used AI-generated deepfake video, fabricated images, and fake local news articles to impersonate Guernsey Chief Minister Lindsay de Sausmarez and promote a non-existent investment scheme. Authorities reportedly warned that the materials falsely depict her endorsing the opportunity. Police advised residents to disregard the posts and avoid providing personal or financial information.
Purportedly AI-Generated Video of Tigers at Barasat Madrasa in West Bengal Reportedly Causes Panic and Student Absenteeism
A purportedly AI-generated video circulated on Facebook allegedly showing tigers roaming the campus of Ula Kalsara Qadria High Madrasa in Barasat, West Bengal. The video was reportedly created by a geography teacher using AI tools and allegedly led to panic among parents and students, with a sharp drop in attendance. The madrasa reportedly issued a show-cause notice to the teacher, who claimed the video was intended as an awareness exercise.
Malta's Prime Minister Robert Abela Reportedly Deepfaked by a Ukrainian National in Cryptocurrency Fraud Targeting Local Residents
A 24-year-old Ukrainian woman, Kateryna Izotkina, was reportedly arrested in Malta after allegedly using an AI-generated deepfake video of Prime Minister Robert Abela to promote a fraudulent cryptocurrency scheme. According to investigators, victims were misled into transferring tens of thousands of euros, including one who reportedly lost €53,250. Police conducted a controlled delivery and detained the suspect, who has been charged with fraud, money laundering, and related offenses.
Purported Deepfake of Barack Obama's Detention Reportedly Amplified by Donald Trump via Truth Social
Donald Trump reportedly reposted an AI-generated deepfake video on Truth Social depicting former President Barack Obama being arrested by FBI agents in the Oval Office. The video was reportedly posted first on TikTok and used manipulated footage of a 2016 meeting between Trump and Obama. It reportedly included scenes of Obama kneeling, being handcuffed, and later shown in a prison jumpsuit. The video also reportedly featured edited audio and visual elements drawn from real political statements.
Alleged Malicious Wiping Command Found in Amazon Q AI Assistant
A reported compromise of Amazon's AI coding assistant "Q" allegedly involved the insertion of commands that, if executed, could have wiped local files and potentially affected cloud resources. The altered code was reportedly incorporated into a public release before being detected and removed.
North Korea's Kimsuky Group Reportedly Uses AI-Generated Military ID Deepfakes in Phishing Campaign
Genians reported a phishing campaign by North Korea's Kimsuky group using purportedly AI-generated deepfake military ID cards. Emails reportedly impersonating South Korean defense institutions carried ZIP files with forged IDs whose photos were reportedly created using generative AI. When opened, hidden malware reportedly executed, downloading scripts disguised as Hancom Office updates. This reportedly marked an evolution in Kimsuky's tactics, using AI decoys to boost social engineering.
Purported Deepfake Videos Allegedly Impersonated Optometrist Joseph Allen to Promote Myopia-Reversal Eyedrops on TikTok
Optometrist and online educator Joseph Allen ("Dr. Eye Health") reported that AI-generated videos using his likeness and voice were circulated on TikTok to promote eyedrops purportedly claiming to reverse myopia. The alleged scam misrepresented Allen's views and discouraged visits to eye-care professionals. They reportedly resurfaced after a takedown.
Purportedly AI-Generated Videos Impersonate Brunei Police in 'Real Money Magic' Scam on Social Media
The Royal Brunei Police Force issued a public warning about purportedly AI-generated deepfake videos impersonating police officers on TikTok, Facebook, and Instagram. The videos allegedly promote a fraudulent investment scheme known as "Real Money Magic," reportedly claiming guaranteed financial returns. Authorities report that scammers use synthetic video and audio to gain victims' trust and induce money transfers. The scam has not been linked to any official institutions.
Purported Deepfake Scam Videos Depict JG Summit Holdings President and CEO Lance Gokongwei Allegedly Endorsing Illicit Investments
The Securities and Exchange Commission of the Philippines reportedly warned of deepfake scam videos and audio purportedly depicting Lance Gokongwei, President and CEO of JG Summit Holdings, endorsing fraudulent crypto and forex investments. Victims are reportedly tricked into entering credit card details and OTPs on a platform allegedly based in Cyprus.
LAMEHUG Malware Reportedly Integrates Large Language Model for Real-Time Command Generation in a Purported APT28-Linked Cyberattack
Ukraine's CERT-UA and Cato CTRL reported LAMEHUG, the first known malware to integrate a large language model (Qwen2.5-Coder-32B-Instruct via Hugging Face) for real-time command generation. Attributed with moderate confidence to APT28 (Fancy Bear), the malware reportedly targeted Ukrainian officials through phishing emails. The LLM is reported to have dynamically generated reconnaissance and data-exfiltration commands executed on infected systems.
Purportedly AI-Cloned Voice of Daughter Used in Elaborate Bond Scam Targeting Retired Couple in Hillsborough County, Florida
A Hillsborough County, Florida, woman was reportedly defrauded of $15,000 in an alleged AI-enabled scam. The perpetrators are reportedly said to have used an AI-generated voice clone of the woman's daughter to impersonate her during a phone call and demand bond money.
Urban VPN Proxy Browser Extension Reportedly Harvested and Sold Private AI Chatbot Conversations via Silent Update
Security researchers reported that the Urban VPN Proxy browser extension introduced AI conversation–harvesting functionality in version 5.5.0, released July 9, 2025. The extension allegedly intercepted and exfiltrated private conversations from AI platforms including ChatGPT, Claude, Gemini, Grok, and others without a user-facing opt-out. The data, including sensitive personal and financial information, was reportedly shared with affiliated data brokers for commercial analytics.
Chicago Veteran Reportedly Loses $10,000 in Purported Deepfake Cryptocurrency Fraud Posing as Elon Musk
A Chicago-area Vietnam War veteran, Richard Lyons, reportedly lost $10,000 to a cryptocurrency scam that used purported AI voice cloning and fake social media profiles to impersonate Elon Musk. The fraudster allegedly convinced Lyons to invest in bogus cryptocurrency opportunities using fake voice memos, images, and spoofed caller IDs showing "Elon Musk." The scam reportedly involved dozens of messages and deepfake audio files that reinforced the impersonation.
Purported Deepfake Video of Donald Trump at NATO Summit Allegedly Used in YouTube Crypto Scam
Multiple YouTube Live streams reportedly featured a purported AI‑generated deepfake video depicting U.S. President Donald Trump at a NATO Summit press event. In the video, Trump reportedly appears to promote a Bitcoin "double-your-money" offer, directing viewers to scan an on‑screen QR code and send cryptocurrency to a specified address. The video was reportedly not authentic and is alleged to have been part of an ongoing YouTube-based crypto scam campaign.
Purported Widespread Use of AI-Generated Deepfake Videos Impersonate Malaysian Leaders in Investment Scams
Purported AI-generated deepfake videos depicting Malaysia's Prime Minister Anwar Ibrahim and other officials, political leaders, and business leaders have reportedly been used to promote fraudulent investment schemes. A total of 13,956 cases were reported last year, with RM2.11 billion allegedly lost to these scams. Victims were allegedly misled by hyper-realistic fake endorsements circulated via Facebook, WhatsApp, and Telegram. Scammers allegedly adapt quickly, generating new deepfakes when content is removed.