AI Incidents
Real-world cases where AI systems caused harm, classified by risk domain and entity. Data sourced from
AIID and classified by MIT AI Risk Initiative. CC BY-SA 4.0
538 incidents
Plymouth, Massachusetts Resident Reportedly Used AI Chatbots CrushOn.ai and JanitorAI to Harass and Intimidate Victims
In January 2025, James Florence Jr. of Plymouth, MA, agreed to plead guilty to cyberstalking charges involving the alleged use of AI tools like CrushOn.ai and JanitorAI. The U.S. Attorney’s Office reports the harassment spanned 2014–2024, though AI-driven tactics reportedly began around 2017. Florence allegedly created deepfake pornographic images, programmed AI chatbots to impersonate victims, distributed doctored content, exposed personal information, and encouraged online harassment.
Former Namibian First Lady Monica Geingos's Likeness Reportedly Used in Purported AI-Generated Video Investment Scams
Namibia's former First Lady Monica Geingos publicly warned that scammers are using purportedly AI-manipulated videos to impersonate her and promote fake forex schemes. Reportedly, deepfake clips and cloned voice calls have convinced victims to hand over savings, including retirement funds. Her team reports the problem worsening across TikTok and other platforms. She urged the public to report fake accounts and ignore messages claiming she offers loans or investments.
Purportedly AI-Generated Deepfake Reportedly Used to Impersonate DNB Bank CFO and CEO in Live Teams Meeting
Unknown cybercriminals reportedly used purported deepfakes to impersonate DNB Bank's CFO and CEO during a live Microsoft Teams meeting, instructing employees at the bank's Singapore office to transfer millions of Singapore dollars. The video and voice were allegedly cloned from public footage and appeared convincing. DNB identified the attempt as a "CEO fraud" and avoided losses, calling it their first encounter with a live deepfake meeting.
Reportedly Manipulated TikTok Videos Misrepresent Anti-AfD Protests as Far-Right Rallies
TikTok videos purportedly depicted large crowds as chanting pro-AfD slogans by reportedly replacing the original audio with manipulated sound. The footage, originally from January 2024 anti-extremism protests, was repurposed in January 2025 to reportedly mislead viewers. Purported AI-generated or altered audio was added to create the illusion of far-right support. Fact-checkers confirmed the deception, and the accounts responsible later deleted the content, claiming no intent to spread misinformation.
Purported AI-Manipulated News Clip Fabricates Explosion and Doctor's Murder Plot for Scam
A purported AI-manipulated video falsely showing Citizen TV anchor Swaleh Mdoe reporting on the bombing of a Kenyan doctor's home circulated widely on Facebook. The video reportedly used AI-generated audio and visuals to fabricate a conspiracy in which pharmaceutical companies targeted the doctor for promoting a "miracle cure." In reality, the explosion footage was from Ohio, the doctor was fictitious, and the content aimed to manipulate viewers into purchasing an unproven health product.
Japanese Teen Allegedly Uses AI-Generated Program to Breach Kaikatsu Frontier and Leak Data of 7.3 Million Customers
A 17-year-old boy in Osaka was reportedly served an arrest warrant for allegedly breaching Kaikatsu Frontier's server using a program purportedly generated with a conversational AI tool. The January cyberattack may have exposed personal data of 7.3 million customers and disrupted business operations. Police say the suspect concealed malicious intent when prompting the AI. He was previously arrested for unrelated credit card fraud.
Prime Minister of Thailand Paetongtarn Shinawatra Claims AI Voice Scam Impersonated ASEAN Leader Requesting Money
Thailand's Prime Minister Paetongtarn Shinawatra reported being targeted by an AI-generated voice scam that mimicked a well-known but undisclosed ASEAN leader. The scam is alleged to have involved a realistic voice message requesting a donation, falsely claiming Thailand was the only ASEAN nation yet to contribute.
Alleged AI-Driven Phishing Scam Impersonates Maine Town Official to Falsely Request $22,500
An alleged AI-generated phishing email targeted a resident of Gray, Maine, falsely claiming to be from the town’s planning department. The alleged email, bearing a fake signature and official-looking letterhead, requested $22,500 for a zoning board meeting. Town officials have reportedly warned residents of increasing risks posed by AI-enabled scams, emphasizing that the town does not accept electronic payments and urging vigilance against similar fraudulent emails.
Yahoo Boys Allegedly Used Deepfake Technology to Impersonate Brad Pitt and Defraud French Woman of $850,000 in Romance Scam
Three Nigerian "Yahoo Boys" scammers allegedly used AI-generated image manipulation tools, along with fake social media and WhatsApp accounts, to reportedly impersonate actor Brad Pitt and convince a French interior decorator, Anne, that she was in a romantic relationship with him. Over 18 months, they allegedly fabricated selfies and messages, reportedly leading Anne to divorce her husband and transfer $850,000 under the false pretense that Pitt needed money for kidney treatment while his accounts were frozen.
Tennessee Meteorologist's Likeness Reportedly Used in Sextortion Campaign Involving Purported AI-Generated Content
Bree Smith, a meteorologist in Nashville, Tennessee, was reportedly targeted in a sextortion campaign involving purported AI-generated deepfakes that manipulated her likeness into explicit content. According to reporting, Smith's face was digitally placed onto semi-nude and nude bodies, with the resulting media circulated online by impersonators seeking money. Smith documented the spread of these accounts and has advocated for legislative responses, including a new Tennessee bill addressing deepfake-related harms.
AI-Assisted Ransomware Campaign by FunkSec Allegedly Targets Over 80 Victims
The FunkSec ransomware group allegedly leveraged AI tools, such as Miniapps chatbots, to develop and refine its ransomware operations, which is reported to have allowed apparently inexperienced actors to produce advanced malware rapidly. It is reported that the group claimed to have launched its data leak site in December 2024, allegedly targeting over 80 victims with ransomware and double extortion tactics. AI reportedly supported the creation of detailed code comments in order to refine the group's technical presentation, while also allegedly facilitating the rapid iteration of its custom encryptor written in Rust.
Purported AI Voice Scam Reportedly Targets Westchester Parents with Fake Kidnapping Ransom Calls
Scammers reportedly used AI voice synthesis to mimic children's voices in fake kidnapping calls, allegedly demanding ransom payments from parents in the Peekskill School District of Westchester, New York. The synthetic voices were reportedly generated from social media voice samples.
Sydney High Schooler Allegedly Generated Deepfakes of Other Students
A Sydney high school student allegedly used AI platforms to create explicit deepfake images of female classmates, which were then distributed through fake social media accounts. The incident reportedly caused significant distress among the victims, leading to an investigation by Campbelltown city police area command and involvement from the eSafety Commissioner.
Alleged Deepfake of New Zealand Endocrinologist Reportedly Promotes Misleading Diabetes Claim
A video circulated on social media that appeared to feature University of Otago endocrinologist Sir Jim Mann allegedly promoting a hemp gummy product for diabetes patients and urging them to stop using metformin. The video was reportedly generated using AI and has been described as spreading manipulated visuals and speech presenting false medical advice.
Aspiring Artist Cherelle Kozak Reportedly Targeted by AI-Powered Impersonation of Rapper Fat Joe
An aspiring artist in Austin, Texas, Cherelle Kozak, was targeted by a scammer using AI-generated video and voice to impersonate rapper Fat Joe. The impersonator appeared on a call, encouraged her to upload music for supposed radio play, and then demanded payment. Kozak did not comply. The scam closely resembled one that Fat Joe publicly warned about on January 5, 2025.