AI Incidents
Real-world cases where AI systems caused harm, classified by risk domain and entity. Data sourced from
AIID and classified by MIT AI Risk Initiative. CC BY-SA 4.0
464 incidents
Purported AI-Manipulated Videos Depict Mauricio Macri Endorsing Manuel Adorni and Silvia Lospennato Withdrawing Before Buenos Aires Vote
Purported AI-generated deepfake videos were reportedly circulated on X in the final hours before the Buenos Aires municipal election in May 2025. The alleged synthetic content depicted Mauricio Macri endorsing Manuel Adorni and Silvia Lospennato withdrawing. Officials reportedly described the material as an attempt to mislead voters. A formal complaint was filed with the electoral tribunal, and an investigation was requested.
Reported Use of Deepfake Video Impersonating Owen Wilson in Romance Scam with Fake Job Payments
A Reddit user reported in May 2025 that her mother is being groomed by scammers using an AI-generated deepfake video impersonating actor Owen Wilson. The scam reportedly began on a game app (Yahtzee with Friends) and shifted to WhatsApp voice calls, with the victim promised a fake Warner Bros job paying small sums via Cash App. The scammer allegedly claims he will buy a house for the victim's family as part of the deception. The video is cited as the main “proof” of authenticity.
FBI Reports Ongoing Vishing and Smishing Campaign Allegedly Targeting Government Officials Using Purportedly AI-Generated Voices
According to a May 15, 2025 public alert from the FBI and IC3, malicious actors have been using purported AI-generated voice messages and smishing tactics since April 2025 to impersonate senior U.S. officials. The campaign reportedly targets government personnel and their contacts to gain access to personal or official accounts. The FBI warns the scheme may involve credential theft and social engineering, with AI voice cloning used to increase believability.
Student Reportedly Files Complaint Over Professor's Undisclosed Use of Generative AI at Northeastern University
A student at Northeastern University reportedly filed a complaint after discovering that a professor had used generative AI tools, including ChatGPT, to produce course materials despite university policies discouraging undisclosed AI use. The student alleged hypocrisy, citing a syllabus that barred unauthorized AI use by students. The professor acknowledged having used AI-generated materials and expressed regret over not reviewing them more carefully. No tuition refund was reportedly granted.
Grok Chatbot Reportedly Inserted Content About South Africa and 'White Genocide' in Unrelated User Queries
xAI's Grok chatbot reportedly inserted unsolicited references to "white genocide" in South Africa into a wide array of unrelated conversations on X. These reported interjections introduced inflammatory, racially charged content into otherwise neutral threads.
Purported AI-Manipulated Videos of Cypriot Officials Circulated in Alleged Investment Fraud
Citizens in Cyprus reported being targeted by an alleged investment scam involving purported AI-manipulated videos that appeared to depict government officials endorsing financial platforms. The Cyprus Consumers Association stated that several individuals suffered significant financial losses after being misled by the videos, which circulated via social media and messaging apps. Authorities are investigating, and the association has warned of potential cross-border spread of the scheme.
Noodlophile Stealer Reportedly Distributed Through Allegedly Fraudulent AI Content Platforms
A campaign reportedly used fake AI video generation sites to distribute malware under the guise of AI-generated content. Promoted via social media, these sites allegedly tricked users into downloading files containing Noodlophile Stealer, a previously unreported infostealer, and in some cases XWorm. The malware harvested credentials and could enable remote access.
Purported Deepfake Video Reportedly Misrepresented CBS Anchor Doug Dunbar and Frisco, Texas, Stabbing Suspect Amid Online Misinformation Campaign
After a fatal stabbing at a Frisco, Texas, high school track meet, online accounts reportedly circulated a purported deepfake video on Instagram that allegedly both altered CBS anchor Doug Dunbar's speech and falsely depicted suspect Karmelo Anthony holding a knife. The manipulated content was reportedly reposted across multiple accounts, spreading misinformation about the case and intensifying inflammatory online discourse after the killing.
Brazilian Authorities Reportedly Link AI-Generated Marcos Mion Videos to Purported Fake Restaurant Promotions in Brazil
A 24-year-old man was reportedly arrested in Santa Helena de Goiás, Brazil, for allegedly using deepfake technology to impersonate TV host Marcos Mion in a fraudulent scheme. Authorities say he created fake promotional videos and websites mimicking the Outback Steakhouse restaurant chain to sell nonexistent discount vouchers. The arrest was reportedly part of Operation VoiceOver, a police initiative targeting AI-driven consumer scams. Charges reportedly include fraud, criminal association, and money laundering.
Scammers Reportedly Used Real-Time Deepfake Video to Impersonate Veriff CEO Kaarel Kotkas in WhatsApp Fraud Attempt
Scammers reportedly targeted Veriff colleague Andrea Rozenberg through WhatsApp with an urgent request and a video call that appeared to show Veriff CEO Kaarel Kotkas. Kotkas and Veriff later described the call as a real-time deepfake or live video clone. Rozenberg reportedly noticed the missing Estonian accent and verified through Slack that the request was fraudulent. No financial loss was reported.
Purported Deepfake Featuring Dr. Rinki Murphy and Jack Tame Reportedly Used to Promote Diabetes Scam in New Zealand
A purported AI-generated deepfake video reportedly impersonated Auckland University diabetes expert Dr. Rinki Murphy, depicting her in a TVNZ interview with journalist Jack Tame promoting a fake diabetes cure. The alleged scam video circulated on social media in April–June 2025, prompting concern that New Zealanders were deceived into stopping prescribed medications. Despite reporting the incident, new variants of the video reportedly continued to emerge.
Mother in Louisville, Kentucky Describes Phone Scam Involving Purported AI-Generated Voice of Her Daughter
Louisville, Kentucky mother Kim Alvey reportedly received a phone call in which an unknown individual purportedly used AI-generated voice cloning to impersonate her 10-year-old daughter, claiming she had been in an accident. The call escalated with a male voice threatening to kidnap the child. Alvey confirmed her daughter was safe at school and identified the call as a scam.
FBI Reports AI Use by Threat Actors in Broader Cyber Context Including Infrastructure Intrusions
FBI Deputy Assistant Director Cynthia Kaiser stated that adversarial actors, particularly those affiliated with China and organized cybercriminal groups, are increasingly integrating AI tools across the cyberattack lifecycle, with documented use cases reportedly including purported AI-generated spear phishing, business identity fabrication, internal network mapping, and deepfake-enabled fraud. The tools are allegedly already assisting intrusions targeting U.S. infrastructure.
Reddit Moderators Report Unauthorized AI Study Involving Fabricated Identities by Purported University of Zurich Researchers
Researchers purportedly affiliated with the University of Zurich reportedly deployed undisclosed AI-generated comments on Reddit's r/ChangeMyView to study persuasion by allegedly fabricating identities such as sexual assault survivors and racial minorities. The experiment reportedly involved unauthorized demographic profiling, emotional manipulation, and violations of subreddit and platform rules. The researchers allegedly deviated from their approved protocol without renewed ethics oversight.
Anthropic Report Details Claude Misuse for Influence Operations, Credential Stuffing, Recruitment Fraud, and Malware Development
In April 2025, Anthropic published a report detailing several misuse cases involving its Claude LLM, all detected in March. These included an "influence-as-a-service" operation that orchestrated over 100 social media bots; an effort to scrape and test leaked credentials for security camera access; a recruitment fraud campaign targeting Eastern Europe; and a novice actor developing sophisticated malware. Anthropic banned the accounts involved but could not confirm downstream deployment.