AI Incidents
Real-world cases where AI systems caused harm, classified by risk domain and entity. Data sourced from 
AIID and classified by 
MIT AI Risk Initiative. CC BY-SA 4.0
464 incidents
Chatbots Allegedly Used in Romance Scams Targeting Nearly One-Third of New Zealand's Dating App Users
A Norton Cyber Safety Insights Report found that nearly one-third of New Zealand dating app users have been targeted by romance scams, with AI chatbots allegedly playing a growing role. The report, based on a January 2025 survey, indicates that 50% of dating app users believed they had interacted with AI-generated messages. Private investigators report cases where victims engage in long-term virtual relationships with fraudsters, often sending money.
Alleged Deepfake Scam Reportedly Promoted Trump Golden Eagles Project as Investment Opportunity
Reports surfaced of a purportedly AI-generated scam falsely promoting the Trump Golden Eagles Project. The purported deepfake videos of Donald Trump, Bank of America CEO Brian Moynihan, and Elon Musk are alleged to have claimed that buyers could trade collectible coins for cash or Tesla stock. A Bay Area veteran reportedly lost $2,500 believing he would earn millions. The scam reportedly circulated via Telegram, and Bank of America denied any involvement.
Purportedly AI-Assisted Impersonation of Martin Henderson in Romance Scam Leads to Reported NZ$375,000 Fraud
An alleged online romance scam exploiting AI-assisted impersonation defrauded a woman, "Lea," of NZ$375,000 over two years. The scammer allegedly used AI-generated voice messages and deceptive text communication to pose as New Zealand actor Martin Henderson and is reported to have built up a relationship beginning in early 2023. The victim, believing the scam was real, reportedly relocated to New Zealand in December 2024, only discovering the fraud in February 2025.
Yahoo Boys Allegedly Using AI-Generated News Videos to Blackmail Sextortion Victims
Scammers, allegedly linked to the Yahoo Boys, are using AI-generated news videos to blackmail victims in sextortion schemes. The videos impersonate news organizations, featuring fabricated reports that accuse victims of crimes, including explicit content distribution. Tutorials for creating these clips are reportedly shared on Telegram, with scammers leveraging the fake broadcasts to pressure victims into paying.
AI Tools Reportedly Used to Fabricate Image of 5,000-Naira Nigerian Banknote Featuring President Bola Tinubu
An image circulated on Nigerian social media in late January 2025 purporting to show a newly issued 5,000-naira banknote featuring President Bola Tinubu. The Central Bank of Nigeria denied the claim, and fact-checkers reported that the image was likely generated using an AI tool linked to the platform X, based on a visible Grok watermark.
Plymouth, Massachusetts Resident Reportedly Used AI Chatbots CrushOn.ai and JanitorAI to Harass and Intimidate Victims
In January 2025, James Florence Jr. of Plymouth, MA, agreed to plead guilty to cyberstalking charges involving the alleged use of AI tools like CrushOn.ai and JanitorAI. The U.S. Attorney’s Office reports the harassment spanned 2014–2024, though AI-driven tactics reportedly began around 2017. Florence allegedly created deepfake pornographic images, programmed AI chatbots to impersonate victims, distributed doctored content, exposed personal information, and encouraged online harassment.
Former Namibian First Lady Monica Geingos's Likeness Reportedly Used in Purported AI-Generated Video Investment Scams
Namibia's former First Lady Monica Geingos publicly warned that scammers are using purportedly AI-manipulated videos to impersonate her and promote fake forex schemes. Reportedly, deepfake clips and cloned voice calls have convinced victims to hand over savings, including retirement funds. Her team reports the problem worsening across TikTok and other platforms. She urged the public to report fake accounts and ignore messages claiming she offers loans or investments.
Reportedly Manipulated TikTok Videos Misrepresent Anti-AfD Protests as Far-Right Rallies
TikTok videos purportedly depicted large crowds as chanting pro-AfD slogans by reportedly replacing the original audio with manipulated sound. The footage, originally from January 2024 anti-extremism protests, was repurposed in January 2025 to reportedly mislead viewers. Purported AI-generated or altered audio was added to create the illusion of far-right support. Fact-checkers confirmed the deception, and the accounts responsible later deleted the content, claiming no intent to spread misinformation.
Japanese Teen Allegedly Uses AI-Generated Program to Breach Kaikatsu Frontier and Leak Data of 7.3 Million Customers
A 17-year-old boy in Osaka was reportedly served an arrest warrant for allegedly breaching Kaikatsu Frontier's server using a program purportedly generated with a conversational AI tool. The January cyberattack may have exposed personal data of 7.3 million customers and disrupted business operations. Police say the suspect concealed malicious intent when prompting the AI. He was previously arrested for unrelated credit card fraud.
Prime Minister of Thailand Paetongtarn Shinawatra Claims AI Voice Scam Impersonated ASEAN Leader Requesting Money
Thailand's Prime Minister Paetongtarn Shinawatra reported being targeted by an AI-generated voice scam that mimicked a well-known but undisclosed ASEAN leader. The scam is alleged to have involved a realistic voice message requesting a donation, falsely claiming Thailand was the only ASEAN nation yet to contribute.
Yahoo Boys Allegedly Used Deepfake Technology to Impersonate Brad Pitt and Defraud French Woman of $850,000 in Romance Scam
Three Nigerian "Yahoo Boys" scammers allegedly used AI-generated image manipulation tools, along with fake social media and WhatsApp accounts, to reportedly impersonate actor Brad Pitt and convince a French interior decorator, Anne, that she was in a romantic relationship with him. Over 18 months, they allegedly fabricated selfies and messages, reportedly leading Anne to divorce her husband and transfer $850,000 under the false pretense that Pitt needed money for kidney treatment while his accounts were frozen.
AI-Assisted Ransomware Campaign by FunkSec Allegedly Targets Over 80 Victims
The FunkSec ransomware group allegedly leveraged AI tools, such as Miniapps chatbots, to develop and refine its ransomware operations, which is reported to have allowed apparently inexperienced actors to produce advanced malware rapidly. It is reported that the group claimed to have launched its data leak site in December 2024, allegedly targeting over 80 victims with ransomware and double extortion tactics. AI reportedly supported the creation of detailed code comments in order to refine the group's technical presentation, while also allegedly facilitating the rapid iteration of its custom encryptor written in Rust.
Pennsylvania State Police Officer Allegedly Used Work Computer for AI-Generated Pornography
A Pennsylvania State Police corporal, Stephen Kamnik, was charged for allegedly using a work computer to store thousands of pornographic files, including content created with deepfake AI software.
Purported AI Voice Scam Reportedly Targets Westchester Parents with Fake Kidnapping Ransom Calls
Scammers reportedly used AI voice synthesis to mimic children's voices in fake kidnapping calls, allegedly demanding ransom payments from parents in the Peekskill School District of Westchester, New York. The synthetic voices were reportedly generated from social media voice samples.
Sydney High Schooler Allegedly Generated Deepfakes of Other Students
A Sydney high school student allegedly used AI platforms to create explicit deepfake images of female classmates, which were then distributed through fake social media accounts. The incident reportedly caused significant distress among the victims, leading to an investigation by Campbelltown city police area command and involvement from the eSafety Commissioner.