AI Incidents
Real-world cases where AI systems caused harm, classified by risk domain and entity. Data sourced from
AIID and classified by MIT AI Risk Initiative. CC BY-SA 4.0
566 incidents
Brazilian Authorities Reportedly Link AI-Generated Marcos Mion Videos to Purported Fake Restaurant Promotions in Brazil
A 24-year-old man was reportedly arrested in Santa Helena de Goiás, Brazil, for allegedly using deepfake technology to impersonate TV host Marcos Mion in a fraudulent scheme. Authorities say he created fake promotional videos and websites mimicking the Outback Steakhouse restaurant chain to sell nonexistent discount vouchers. The arrest was reportedly part of Operation VoiceOver, a police initiative targeting AI-driven consumer scams. Charges reportedly include fraud, criminal association, and money laundering.
Institute for Strategic Dialogue Reports Russian-Aligned Operation Overload Using Purported AI-Generated Impersonations Across January to March 2025
Researchers at the Institute for Strategic Dialogue (ISD) report that Operation Overload (also known as Matryoshka or Storm-1679) is a Russian-aligned campaign leveraging purported AI-generated voiceovers and visual impersonations to spread false or inflammatory content across platforms. The campaign reportedly involved at least 135 discrete posts analyzed by ISD in early 2025 targeting institutions and individuals, including one purported viral video claiming USAID funded celebrity trips to Ukraine (see Incident 1061).
Purported AI-Generated YouTube Network Reportedly Promoted Alberta Secession and U.S. Annexation Narratives
Researchers reported that a network of 20 inauthentic YouTube channels used purportedly AI-generated avatars and voiceovers with deepfake-style thumbnails, as well as paid voice actors, to pose as Albertan commentators and promote false or misleading claims about Alberta secession and U.S. annexation. The channels allegedly drew nearly 40 million views and distorted political debate, reportedly undermining Canada's information ecosystem.
Scammers Reportedly Used Real-Time Deepfake Video to Impersonate Veriff CEO Kaarel Kotkas in WhatsApp Fraud Attempt
Scammers reportedly targeted Veriff colleague Andrea Rozenberg through WhatsApp with an urgent request and a video call that appeared to show Veriff CEO Kaarel Kotkas. Kotkas and Veriff later described the call as a real-time deepfake or live video clone. Rozenberg reportedly noticed the missing Estonian accent and verified through Slack that the request was fraudulent. No financial loss was reported.
Purported Deepfake Featuring Dr. Rinki Murphy and Jack Tame Reportedly Used to Promote Diabetes Scam in New Zealand
A purported AI-generated deepfake video reportedly impersonated Auckland University diabetes expert Dr. Rinki Murphy, depicting her in a TVNZ interview with journalist Jack Tame promoting a fake diabetes cure. The alleged scam video circulated on social media in April–June 2025, prompting concern that New Zealanders were deceived into stopping prescribed medications. Despite reporting the incident, new variants of the video reportedly continued to emerge.
Mother in Louisville, Kentucky Describes Phone Scam Involving Purported AI-Generated Voice of Her Daughter
Louisville, Kentucky mother Kim Alvey reportedly received a phone call in which an unknown individual purportedly used AI-generated voice cloning to impersonate her 10-year-old daughter, claiming she had been in an accident. The call escalated with a male voice threatening to kidnap the child. Alvey confirmed her daughter was safe at school and identified the call as a scam.
FBI Reports AI Use by Threat Actors in Broader Cyber Context Including Infrastructure Intrusions
FBI Deputy Assistant Director Cynthia Kaiser stated that adversarial actors, particularly those affiliated with China and organized cybercriminal groups, are increasingly integrating AI tools across the cyberattack lifecycle, with documented use cases reportedly including purported AI-generated spear phishing, business identity fabrication, internal network mapping, and deepfake-enabled fraud. The tools are allegedly already assisting intrusions targeting U.S. infrastructure.
Australian Analyst Allegedly Targeted by Scam Using Purportedly Sophisticated AI-Generated Corporate Materials
A report by ABC News Australia describes how scammers allegedly used AI tools to create detailed fake websites for two fabricated companies, APPC Capital Singapore and Thackeray Mines and Minerals Inc., as part of an investment scam. A pseudonymous Australian fraud analyst ("Leon") was reportedly targeted. Experts cited in the article warn that AI lowers the barrier for generating convincing scams that can deceive even experienced analysts.
Reddit Moderators Report Unauthorized AI Study Involving Fabricated Identities by Purported University of Zurich Researchers
Researchers purportedly affiliated with the University of Zurich reportedly deployed undisclosed AI-generated comments on Reddit's r/ChangeMyView to study persuasion by allegedly fabricating identities such as sexual assault survivors and racial minorities. The experiment reportedly involved unauthorized demographic profiling, emotional manipulation, and violations of subreddit and platform rules. The researchers allegedly deviated from their approved protocol without renewed ethics oversight.
Anthropic Report Details Claude Misuse for Influence Operations, Credential Stuffing, Recruitment Fraud, and Malware Development
In April 2025, Anthropic published a report detailing several misuse cases involving its Claude LLM, all detected in March. These included an "influence-as-a-service" operation that orchestrated over 100 social media bots; an effort to scrape and test leaked credentials for security camera access; a recruitment fraud campaign targeting Eastern Europe; and a novice actor developing sophisticated malware. Anthropic banned the accounts involved but could not confirm downstream deployment.
Purported AI-Generated Deepfake of Steven Bartlett Reportedly Used to Promote Fake WhatsApp Investment Group
A purported deepfake video of entrepreneur and BBC Dragon's Den investor Steven Bartlett circulated on Instagram in April 2025, allegedly claiming to offer exclusive stock tips and inviting users to join a WhatsApp trading group. The reported video referenced U.S. tariff policies to entice viewers with promises of rapid returns. Bartlett's team confirmed the video was fake and worked with platforms to remove it, warning that scammers were attempting to harvest contact details for further fraud.
Scammers Reportedly Use AI Tools to Impersonate Students and Obtain Federal Aid
Between 2021 and 2025, California community colleges faced a surge in fraudulent applications—now estimated at 34% of all submissions. Reports indicate that scammers used generative AI tools, including ChatGPT, to produce identity-verifying responses that enabled them to impersonate students and obtain financial aid. The fraud allegedly resulted in over $13 million in losses over the past year alone, straining administrative and instructional systems and displacing legitimate applicants.
Purported Deepfake Video Circulated Among Students Targets Orrington, Maine Educator
An Orrington, Maine public school teacher was the target of a purported AI‑generated deepfake video depicting their likeness, according to the AOS 47 superintendent. The manipulated content was reportedly shared and circulated by some students. The district confirmed the video had no basis in reality, reported the hosting account, and had the post removed, while affirming support for the teacher and warning about the harms of AI‑based impersonation.
Alleged Deepfake Identity Scam Uses Miami Beach Realtor's Likeness to Defraud Victim in the United Kingdom in Purported Romance Scam
A scammer reportedly used deepfake video technology to impersonate Miami Beach realtor Andres Asion, creating fake videos with his face and a voice clone to catfish a woman in the UK. The victim communicated for about a year before traveling to Miami, where Asion discovered the fraud. The videos appeared convincing even to friends and family.
ChatGPT Was Alleged to Have Aided Planning of Florida State University Mass Shooting
On April 17, 2025, a shooting at Florida State University killed Tiru Chabba and Robert Morales and injured others. Phoenix Ikner, the accused shooter, has pleaded not guilty. In 2026, victims' families and attorneys reportedly alleged that Ikner used ChatGPT before the attack to discuss mass shootings, firearms, campus activity, and media attention, and that OpenAI failed to flag or escalate the exchanges. OpenAI denied responsibility.