AI Incidents
Real-world cases where AI systems caused harm, classified by risk domain and entity. Data sourced from
AIID and classified by MIT AI Risk Initiative. CC BY-SA 4.0
526 incidents
Purported Unauthorized Deepfakes of Norman Swan and Others Circulated in Online Supplement Campaigns
According to an ABC News (Australia) 7.30 report, a second wave of deepfake scam ads impersonating Norman Swan and other public figures circulated widely on Meta platforms in 2025, promoting unproven health supplements. The campaign featured new voice-cloned videos and more impersonation tactics, and it reportedly contributed to financial and health harms. Investigators reportedly linked the ads to businesses in Australia and New Zealand using deceptive redirects and alias branding.
New Jersey Man Cornelius Shannon Allegedly Published Hundreds of AI-Generated Deepfake Pornography Albums in TAKE IT DOWN Act Case
In one of the first prosecutions under the TAKE IT DOWN Act, DOJ alleged that New Jersey defendant Cornelius Shannon published at least 360 albums of AI-generated deepfake pornography depicting about 90 women, including public figures, beginning during a charged period anchored to May 2025. Prosecutors said the content appeared on an adult image- and video-sharing platform and was viewed millions of times.
Purported AI-Manipulated Videos Depict Mauricio Macri Endorsing Manuel Adorni and Silvia Lospennato Withdrawing Before Buenos Aires Vote
Purported AI-generated deepfake videos were reportedly circulated on X in the final hours before the Buenos Aires municipal election in May 2025. The alleged synthetic content depicted Mauricio Macri endorsing Manuel Adorni and Silvia Lospennato withdrawing. Officials reportedly described the material as an attempt to mislead voters. A formal complaint was filed with the electoral tribunal, and an investigation was requested.
Reported Use of Deepfake Video Impersonating Owen Wilson in Romance Scam with Fake Job Payments
A Reddit user reported in May 2025 that her mother is being groomed by scammers using an AI-generated deepfake video impersonating actor Owen Wilson. The scam reportedly began on a game app (Yahtzee with Friends) and shifted to WhatsApp voice calls, with the victim promised a fake Warner Bros job paying small sums via Cash App. The scammer allegedly claims he will buy a house for the victim's family as part of the deception. The video is cited as the main “proof” of authenticity.
FBI Reports Ongoing Vishing and Smishing Campaign Allegedly Targeting Government Officials Using Purportedly AI-Generated Voices
According to a May 15, 2025 public alert from the FBI and IC3, malicious actors have been using purported AI-generated voice messages and smishing tactics since April 2025 to impersonate senior U.S. officials. The campaign reportedly targets government personnel and their contacts to gain access to personal or official accounts. The FBI warns the scheme may involve credential theft and social engineering, with AI voice cloning used to increase believability.
Student Reportedly Files Complaint Over Professor's Undisclosed Use of Generative AI at Northeastern University
A student at Northeastern University reportedly filed a complaint after discovering that a professor had used generative AI tools, including ChatGPT, to produce course materials despite university policies discouraging undisclosed AI use. The student alleged hypocrisy, citing a syllabus that barred unauthorized AI use by students. The professor acknowledged having used AI-generated materials and expressed regret over not reviewing them more carefully. No tuition refund was reportedly granted.
Grok Chatbot Reportedly Inserted Content About South Africa and 'White Genocide' in Unrelated User Queries
xAI's Grok chatbot reportedly inserted unsolicited references to "white genocide" in South Africa into a wide array of unrelated conversations on X. These reported interjections introduced inflammatory, racially charged content into otherwise neutral threads.
Purported AI-Manipulated Videos of Cypriot Officials Circulated in Alleged Investment Fraud
Citizens in Cyprus reported being targeted by an alleged investment scam involving purported AI-manipulated videos that appeared to depict government officials endorsing financial platforms. The Cyprus Consumers Association stated that several individuals suffered significant financial losses after being misled by the videos, which circulated via social media and messaging apps. Authorities are investigating, and the association has warned of potential cross-border spread of the scheme.
Noodlophile Stealer Reportedly Distributed Through Allegedly Fraudulent AI Content Platforms
A campaign reportedly used fake AI video generation sites to distribute malware under the guise of AI-generated content. Promoted via social media, these sites allegedly tricked users into downloading files containing Noodlophile Stealer, a previously unreported infostealer, and in some cases XWorm. The malware harvested credentials and could enable remote access.
Purported Deepfake Video Reportedly Misrepresented CBS Anchor Doug Dunbar and Frisco, Texas, Stabbing Suspect Amid Online Misinformation Campaign
After a fatal stabbing at a Frisco, Texas, high school track meet, online accounts reportedly circulated a purported deepfake video on Instagram that allegedly both altered CBS anchor Doug Dunbar's speech and falsely depicted suspect Karmelo Anthony holding a knife. The manipulated content was reportedly reposted across multiple accounts, spreading misinformation about the case and intensifying inflammatory online discourse after the killing.
Brazilian Authorities Reportedly Link AI-Generated Marcos Mion Videos to Purported Fake Restaurant Promotions in Brazil
A 24-year-old man was reportedly arrested in Santa Helena de Goiás, Brazil, for allegedly using deepfake technology to impersonate TV host Marcos Mion in a fraudulent scheme. Authorities say he created fake promotional videos and websites mimicking the Outback Steakhouse restaurant chain to sell nonexistent discount vouchers. The arrest was reportedly part of Operation VoiceOver, a police initiative targeting AI-driven consumer scams. Charges reportedly include fraud, criminal association, and money laundering.
Judge Reportedly Disqualifies Butler Snow Lawyers Following Purported Use of ChatGPT-Fabricated Citations in Alabama Prison Litigation
Three Butler Snow attorneys defending a former Alabama corrections commissioner were reportedly disqualified after two motions cited five non-existent cases generated via ChatGPT. Judge Anna Manasco is reported to have publicly reprimanded the lawyers, referred them to the Alabama State Bar, and ordered broad disclosure; she declined to sanction the firm. An external review of 2,400 citations across 330 filings reported no further errors.
Scammers Reportedly Used Real-Time Deepfake Video to Impersonate Veriff CEO Kaarel Kotkas in WhatsApp Fraud Attempt
Scammers reportedly targeted Veriff colleague Andrea Rozenberg through WhatsApp with an urgent request and a video call that appeared to show Veriff CEO Kaarel Kotkas. Kotkas and Veriff later described the call as a real-time deepfake or live video clone. Rozenberg reportedly noticed the missing Estonian accent and verified through Slack that the request was fraudulent. No financial loss was reported.
Purported Deepfake Featuring Dr. Rinki Murphy and Jack Tame Reportedly Used to Promote Diabetes Scam in New Zealand
A purported AI-generated deepfake video reportedly impersonated Auckland University diabetes expert Dr. Rinki Murphy, depicting her in a TVNZ interview with journalist Jack Tame promoting a fake diabetes cure. The alleged scam video circulated on social media in April–June 2025, prompting concern that New Zealanders were deceived into stopping prescribed medications. Despite reporting the incident, new variants of the video reportedly continued to emerge.
Mother in Louisville, Kentucky Describes Phone Scam Involving Purported AI-Generated Voice of Her Daughter
Louisville, Kentucky mother Kim Alvey reportedly received a phone call in which an unknown individual purportedly used AI-generated voice cloning to impersonate her 10-year-old daughter, claiming she had been in an accident. The call escalated with a male voice threatening to kidnap the child. Alvey confirmed her daughter was safe at school and identified the call as a scam.