AI Incidents
Real-world cases where AI systems caused harm, classified by risk domain and entity. Data sourced from 
AIID and classified by 
MIT AI Risk Initiative. CC BY-SA 4.0
368 incidents
Purported Unauthorized Deepfakes of Norman Swan and Others Circulated in Online Supplement Campaigns
According to an ABC News (Australia) 7.30 report, a second wave of deepfake scam ads impersonating Norman Swan and other public figures circulated widely on Meta platforms in 2025, promoting unproven health supplements. The campaign featured new voice-cloned videos and more impersonation tactics, and it reportedly contributed to financial and health harms. Investigators reportedly linked the ads to businesses in Australia and New Zealand using deceptive redirects and alias branding.
New Jersey Man Cornelius Shannon Allegedly Published Hundreds of AI-Generated Deepfake Pornography Albums in TAKE IT DOWN Act Case
In one of the first prosecutions under the TAKE IT DOWN Act, DOJ alleged that New Jersey defendant Cornelius Shannon published at least 360 albums of AI-generated deepfake pornography depicting about 90 women, including public figures, beginning during a charged period anchored to May 2025. Prosecutors said the content appeared on an adult image- and video-sharing platform and was viewed millions of times.
Purported AI-Manipulated Videos Depict Mauricio Macri Endorsing Manuel Adorni and Silvia Lospennato Withdrawing Before Buenos Aires Vote
Purported AI-generated deepfake videos were reportedly circulated on X in the final hours before the Buenos Aires municipal election in May 2025. The alleged synthetic content depicted Mauricio Macri endorsing Manuel Adorni and Silvia Lospennato withdrawing. Officials reportedly described the material as an attempt to mislead voters. A formal complaint was filed with the electoral tribunal, and an investigation was requested.
Reported Use of Deepfake Video Impersonating Owen Wilson in Romance Scam with Fake Job Payments
A Reddit user reported in May 2025 that her mother is being groomed by scammers using an AI-generated deepfake video impersonating actor Owen Wilson. The scam reportedly began on a game app (Yahtzee with Friends) and shifted to WhatsApp voice calls, with the victim promised a fake Warner Bros job paying small sums via Cash App. The scammer allegedly claims he will buy a house for the victim's family as part of the deception. The video is cited as the main “proof” of authenticity.
FBI Reports Ongoing Vishing and Smishing Campaign Allegedly Targeting Government Officials Using Purportedly AI-Generated Voices
According to a May 15, 2025 public alert from the FBI and IC3, malicious actors have been using purported AI-generated voice messages and smishing tactics since April 2025 to impersonate senior U.S. officials. The campaign reportedly targets government personnel and their contacts to gain access to personal or official accounts. The FBI warns the scheme may involve credential theft and social engineering, with AI voice cloning used to increase believability.
Purported AI-Manipulated Videos of Cypriot Officials Circulated in Alleged Investment Fraud
Citizens in Cyprus reported being targeted by an alleged investment scam involving purported AI-manipulated videos that appeared to depict government officials endorsing financial platforms. The Cyprus Consumers Association stated that several individuals suffered significant financial losses after being misled by the videos, which circulated via social media and messaging apps. Authorities are investigating, and the association has warned of potential cross-border spread of the scheme.
Noodlophile Stealer Reportedly Distributed Through Allegedly Fraudulent AI Content Platforms
A campaign reportedly used fake AI video generation sites to distribute malware under the guise of AI-generated content. Promoted via social media, these sites allegedly tricked users into downloading files containing Noodlophile Stealer, a previously unreported infostealer, and in some cases XWorm. The malware harvested credentials and could enable remote access.
Purported Deepfake Video Reportedly Misrepresented CBS Anchor Doug Dunbar and Frisco, Texas, Stabbing Suspect Amid Online Misinformation Campaign
After a fatal stabbing at a Frisco, Texas, high school track meet, online accounts reportedly circulated a purported deepfake video on Instagram that allegedly both altered CBS anchor Doug Dunbar's speech and falsely depicted suspect Karmelo Anthony holding a knife. The manipulated content was reportedly reposted across multiple accounts, spreading misinformation about the case and intensifying inflammatory online discourse after the killing.
Brazilian Authorities Reportedly Link AI-Generated Marcos Mion Videos to Purported Fake Restaurant Promotions in Brazil
A 24-year-old man was reportedly arrested in Santa Helena de Goiás, Brazil, for allegedly using deepfake technology to impersonate TV host Marcos Mion in a fraudulent scheme. Authorities say he created fake promotional videos and websites mimicking the Outback Steakhouse restaurant chain to sell nonexistent discount vouchers. The arrest was reportedly part of Operation VoiceOver, a police initiative targeting AI-driven consumer scams. Charges reportedly include fraud, criminal association, and money laundering.
Scammers Reportedly Used Real-Time Deepfake Video to Impersonate Veriff CEO Kaarel Kotkas in WhatsApp Fraud Attempt
Scammers reportedly targeted Veriff colleague Andrea Rozenberg through WhatsApp with an urgent request and a video call that appeared to show Veriff CEO Kaarel Kotkas. Kotkas and Veriff later described the call as a real-time deepfake or live video clone. Rozenberg reportedly noticed the missing Estonian accent and verified through Slack that the request was fraudulent. No financial loss was reported.
Purported Deepfake Featuring Dr. Rinki Murphy and Jack Tame Reportedly Used to Promote Diabetes Scam in New Zealand
A purported AI-generated deepfake video reportedly impersonated Auckland University diabetes expert Dr. Rinki Murphy, depicting her in a TVNZ interview with journalist Jack Tame promoting a fake diabetes cure. The alleged scam video circulated on social media in April–June 2025, prompting concern that New Zealanders were deceived into stopping prescribed medications. Despite reporting the incident, new variants of the video reportedly continued to emerge.
Mother in Louisville, Kentucky Describes Phone Scam Involving Purported AI-Generated Voice of Her Daughter
Louisville, Kentucky mother Kim Alvey reportedly received a phone call in which an unknown individual purportedly used AI-generated voice cloning to impersonate her 10-year-old daughter, claiming she had been in an accident. The call escalated with a male voice threatening to kidnap the child. Alvey confirmed her daughter was safe at school and identified the call as a scam.
FBI Reports AI Use by Threat Actors in Broader Cyber Context Including Infrastructure Intrusions
FBI Deputy Assistant Director Cynthia Kaiser stated that adversarial actors, particularly those affiliated with China and organized cybercriminal groups, are increasingly integrating AI tools across the cyberattack lifecycle, with documented use cases reportedly including purported AI-generated spear phishing, business identity fabrication, internal network mapping, and deepfake-enabled fraud. The tools are allegedly already assisting intrusions targeting U.S. infrastructure.
Reddit Moderators Report Unauthorized AI Study Involving Fabricated Identities by Purported University of Zurich Researchers
Researchers purportedly affiliated with the University of Zurich reportedly deployed undisclosed AI-generated comments on Reddit's r/ChangeMyView to study persuasion by allegedly fabricating identities such as sexual assault survivors and racial minorities. The experiment reportedly involved unauthorized demographic profiling, emotional manipulation, and violations of subreddit and platform rules. The researchers allegedly deviated from their approved protocol without renewed ethics oversight.
Anthropic Report Details Claude Misuse for Influence Operations, Credential Stuffing, Recruitment Fraud, and Malware Development
In April 2025, Anthropic published a report detailing several misuse cases involving its Claude LLM, all detected in March. These included an "influence-as-a-service" operation that orchestrated over 100 social media bots; an effort to scrape and test leaked credentials for security camera access; a recruitment fraud campaign targeting Eastern Europe; and a novice actor developing sophisticated malware. Anthropic banned the accounts involved but could not confirm downstream deployment.