AI Incidents
Real-world cases where AI systems caused harm, classified by risk domain and entity. Data sourced from
AIID and classified by MIT AI Risk Initiative. CC BY-SA 4.0
736 incidents
Reported Use of Deepfake Video Impersonating Owen Wilson in Romance Scam with Fake Job Payments
A Reddit user reported in May 2025 that her mother is being groomed by scammers using an AI-generated deepfake video impersonating actor Owen Wilson. The scam reportedly began on a game app (Yahtzee with Friends) and shifted to WhatsApp voice calls, with the victim promised a fake Warner Bros job paying small sums via Cash App. The scammer allegedly claims he will buy a house for the victim's family as part of the deception. The video is cited as the main “proof” of authenticity.
FBI Reports Ongoing Vishing and Smishing Campaign Allegedly Targeting Government Officials Using Purportedly AI-Generated Voices
According to a May 15, 2025 public alert from the FBI and IC3, malicious actors have been using purported AI-generated voice messages and smishing tactics since April 2025 to impersonate senior U.S. officials. The campaign reportedly targets government personnel and their contacts to gain access to personal or official accounts. The FBI warns the scheme may involve credential theft and social engineering, with AI voice cloning used to increase believability.
Student Reportedly Files Complaint Over Professor's Undisclosed Use of Generative AI at Northeastern University
A student at Northeastern University reportedly filed a complaint after discovering that a professor had used generative AI tools, including ChatGPT, to produce course materials despite university policies discouraging undisclosed AI use. The student alleged hypocrisy, citing a syllabus that barred unauthorized AI use by students. The professor acknowledged having used AI-generated materials and expressed regret over not reviewing them more carefully. No tuition refund was reportedly granted.
Grok Chatbot Reportedly Inserted Content About South Africa and 'White Genocide' in Unrelated User Queries
xAI's Grok chatbot reportedly inserted unsolicited references to "white genocide" in South Africa into a wide array of unrelated conversations on X. These reported interjections introduced inflammatory, racially charged content into otherwise neutral threads.
Texas Homeowner Reportedly Spent $3,000 to Contest AI-Flagged Warning of Insurance Nonrenewal
In Texas, homeowners including Tracy Gartenmann reported warnings against insurance nonrenewals based on aerial imagery flagged by AI systems. Gartenmann's insurer, Travelers, reportedly cited overhanging trees. She reportedly spent $3,000 to address the issue and retain coverage. While the AI system appears to have functioned as intended, critics argue it lacks adequate human oversight and imposes material and emotional burdens on policyholders. Other cases reportedly involved disputed roof assessments. Companies such as State Farm and Nationwide used vendors like CAPE Analytics and Nearmap.
Purported AI-Manipulated Videos of Cypriot Officials Circulated in Alleged Investment Fraud
Citizens in Cyprus reported being targeted by an alleged investment scam involving purported AI-manipulated videos that appeared to depict government officials endorsing financial platforms. The Cyprus Consumers Association stated that several individuals suffered significant financial losses after being misled by the videos, which circulated via social media and messaging apps. Authorities are investigating, and the association has warned of potential cross-border spread of the scheme.
Noodlophile Stealer Reportedly Distributed Through Allegedly Fraudulent AI Content Platforms
A campaign reportedly used fake AI video generation sites to distribute malware under the guise of AI-generated content. Promoted via social media, these sites allegedly tricked users into downloading files containing Noodlophile Stealer, a previously unreported infostealer, and in some cases XWorm. The malware harvested credentials and could enable remote access.
Purported Deepfake Video Reportedly Misrepresented CBS Anchor Doug Dunbar and Frisco, Texas, Stabbing Suspect Amid Online Misinformation Campaign
After a fatal stabbing at a Frisco, Texas, high school track meet, online accounts reportedly circulated a purported deepfake video on Instagram that allegedly both altered CBS anchor Doug Dunbar's speech and falsely depicted suspect Karmelo Anthony holding a knife. The manipulated content was reportedly reposted across multiple accounts, spreading misinformation about the case and intensifying inflammatory online discourse after the killing.
Brazilian Authorities Reportedly Link AI-Generated Marcos Mion Videos to Purported Fake Restaurant Promotions in Brazil
A 24-year-old man was reportedly arrested in Santa Helena de Goiás, Brazil, for allegedly using deepfake technology to impersonate TV host Marcos Mion in a fraudulent scheme. Authorities say he created fake promotional videos and websites mimicking the Outback Steakhouse restaurant chain to sell nonexistent discount vouchers. The arrest was reportedly part of Operation VoiceOver, a police initiative targeting AI-driven consumer scams. Charges reportedly include fraud, criminal association, and money laundering.
Institute for Strategic Dialogue Reports Russian-Aligned Operation Overload Using Purported AI-Generated Impersonations Across January to March 2025
Researchers at the Institute for Strategic Dialogue (ISD) report that Operation Overload (also known as Matryoshka or Storm-1679) is a Russian-aligned campaign leveraging purported AI-generated voiceovers and visual impersonations to spread false or inflammatory content across platforms. The campaign reportedly involved at least 135 discrete posts analyzed by ISD in early 2025 targeting institutions and individuals, including one purported viral video claiming USAID funded celebrity trips to Ukraine (see Incident 1061).
Purported AI-Generated YouTube Network Reportedly Promoted Alberta Secession and U.S. Annexation Narratives
Researchers reported that a network of 20 inauthentic YouTube channels used purportedly AI-generated avatars and voiceovers with deepfake-style thumbnails, as well as paid voice actors, to pose as Albertan commentators and promote false or misleading claims about Alberta secession and U.S. annexation. The channels allegedly drew nearly 40 million views and distorted political debate, reportedly undermining Canada's information ecosystem.
Scammers Reportedly Used Real-Time Deepfake Video to Impersonate Veriff CEO Kaarel Kotkas in WhatsApp Fraud Attempt
Scammers reportedly targeted Veriff colleague Andrea Rozenberg through WhatsApp with an urgent request and a video call that appeared to show Veriff CEO Kaarel Kotkas. Kotkas and Veriff later described the call as a real-time deepfake or live video clone. Rozenberg reportedly noticed the missing Estonian accent and verified through Slack that the request was fraudulent. No financial loss was reported.
Purported Deepfake Featuring Dr. Rinki Murphy and Jack Tame Reportedly Used to Promote Diabetes Scam in New Zealand
A purported AI-generated deepfake video reportedly impersonated Auckland University diabetes expert Dr. Rinki Murphy, depicting her in a TVNZ interview with journalist Jack Tame promoting a fake diabetes cure. The alleged scam video circulated on social media in April–June 2025, prompting concern that New Zealanders were deceived into stopping prescribed medications. Despite reporting the incident, new variants of the video reportedly continued to emerge.
Mother in Louisville, Kentucky Describes Phone Scam Involving Purported AI-Generated Voice of Her Daughter
Louisville, Kentucky mother Kim Alvey reportedly received a phone call in which an unknown individual purportedly used AI-generated voice cloning to impersonate her 10-year-old daughter, claiming she had been in an accident. The call escalated with a male voice threatening to kidnap the child. Alvey confirmed her daughter was safe at school and identified the call as a scam.
FBI Reports AI Use by Threat Actors in Broader Cyber Context Including Infrastructure Intrusions
FBI Deputy Assistant Director Cynthia Kaiser stated that adversarial actors, particularly those affiliated with China and organized cybercriminal groups, are increasingly integrating AI tools across the cyberattack lifecycle, with documented use cases reportedly including purported AI-generated spear phishing, business identity fabrication, internal network mapping, and deepfake-enabled fraud. The tools are allegedly already assisting intrusions targeting U.S. infrastructure.