AI Incidents
Real-world cases where AI systems caused harm, classified by risk domain and entity. Data sourced from
AIID and classified by MIT AI Risk Initiative. CC BY-SA 4.0
368 incidents
Former Namibian First Lady Monica Geingos's Likeness Reportedly Used in Purported AI-Generated Video Investment Scams
Namibia's former First Lady Monica Geingos publicly warned that scammers are using purportedly AI-manipulated videos to impersonate her and promote fake forex schemes. Reportedly, deepfake clips and cloned voice calls have convinced victims to hand over savings, including retirement funds. Her team reports the problem worsening across TikTok and other platforms. She urged the public to report fake accounts and ignore messages claiming she offers loans or investments.
Reportedly Manipulated TikTok Videos Misrepresent Anti-AfD Protests as Far-Right Rallies
TikTok videos purportedly depicted large crowds as chanting pro-AfD slogans by reportedly replacing the original audio with manipulated sound. The footage, originally from January 2024 anti-extremism protests, was repurposed in January 2025 to reportedly mislead viewers. Purported AI-generated or altered audio was added to create the illusion of far-right support. Fact-checkers confirmed the deception, and the accounts responsible later deleted the content, claiming no intent to spread misinformation.
Japanese Teen Allegedly Uses AI-Generated Program to Breach Kaikatsu Frontier and Leak Data of 7.3 Million Customers
A 17-year-old boy in Osaka was reportedly served an arrest warrant for allegedly breaching Kaikatsu Frontier's server using a program purportedly generated with a conversational AI tool. The January cyberattack may have exposed personal data of 7.3 million customers and disrupted business operations. Police say the suspect concealed malicious intent when prompting the AI. He was previously arrested for unrelated credit card fraud.
Prime Minister of Thailand Paetongtarn Shinawatra Claims AI Voice Scam Impersonated ASEAN Leader Requesting Money
Thailand's Prime Minister Paetongtarn Shinawatra reported being targeted by an AI-generated voice scam that mimicked a well-known but undisclosed ASEAN leader. The scam is alleged to have involved a realistic voice message requesting a donation, falsely claiming Thailand was the only ASEAN nation yet to contribute.
Yahoo Boys Allegedly Used Deepfake Technology to Impersonate Brad Pitt and Defraud French Woman of $850,000 in Romance Scam
Three Nigerian "Yahoo Boys" scammers allegedly used AI-generated image manipulation tools, along with fake social media and WhatsApp accounts, to reportedly impersonate actor Brad Pitt and convince a French interior decorator, Anne, that she was in a romantic relationship with him. Over 18 months, they allegedly fabricated selfies and messages, reportedly leading Anne to divorce her husband and transfer $850,000 under the false pretense that Pitt needed money for kidney treatment while his accounts were frozen.
AI-Assisted Ransomware Campaign by FunkSec Allegedly Targets Over 80 Victims
The FunkSec ransomware group allegedly leveraged AI tools, such as Miniapps chatbots, to develop and refine its ransomware operations, which is reported to have allowed apparently inexperienced actors to produce advanced malware rapidly. It is reported that the group claimed to have launched its data leak site in December 2024, allegedly targeting over 80 victims with ransomware and double extortion tactics. AI reportedly supported the creation of detailed code comments in order to refine the group's technical presentation, while also allegedly facilitating the rapid iteration of its custom encryptor written in Rust.
Purported AI Voice Scam Reportedly Targets Westchester Parents with Fake Kidnapping Ransom Calls
Scammers reportedly used AI voice synthesis to mimic children's voices in fake kidnapping calls, allegedly demanding ransom payments from parents in the Peekskill School District of Westchester, New York. The synthetic voices were reportedly generated from social media voice samples.
Sydney High Schooler Allegedly Generated Deepfakes of Other Students
A Sydney high school student allegedly used AI platforms to create explicit deepfake images of female classmates, which were then distributed through fake social media accounts. The incident reportedly caused significant distress among the victims, leading to an investigation by Campbelltown city police area command and involvement from the eSafety Commissioner.
Alleged Deepfake of New Zealand Endocrinologist Reportedly Promotes Misleading Diabetes Claim
A video circulated on social media that appeared to feature University of Otago endocrinologist Sir Jim Mann allegedly promoting a hemp gummy product for diabetes patients and urging them to stop using metformin. The video was reportedly generated using AI and has been described as spreading manipulated visuals and speech presenting false medical advice.
Aspiring Artist Cherelle Kozak Reportedly Targeted by AI-Powered Impersonation of Rapper Fat Joe
An aspiring artist in Austin, Texas, Cherelle Kozak, was targeted by a scammer using AI-generated video and voice to impersonate rapper Fat Joe. The impersonator appeared on a call, encouraged her to upload music for supposed radio play, and then demanded payment. Kozak did not comply. The scam closely resembled one that Fat Joe publicly warned about on January 5, 2025.
Hong Kong Authorities Seize HK$34M in Alleged Deepfake Scam Targeting Victims in Taiwan, Singapore, and Malaysia
Hong Kong police arrested 31 people linked to a deepfake scam syndicate that allegedly defrauded victims in Taiwan, Singapore, and Malaysia. The group used AI-generated images to impersonate wealthy women, training recruits to discuss luxury lifestyles, finance, and cryptocurrency to gain trust. Scammers reportedly persuaded victims to invest in fraudulent schemes, with police intercepting HK$34 million in illicit proceeds.
Alleged Deepfake of Luis Suárez Used to Scam Uruguayans in Fake Investment Scheme
On December 26, 2024, UTE, Uruguay's public utility company, warned of an alleged deepfake video circulating on Instagram, Facebook, and Threads. The video reportedly features manipulated images and voice of footballer Luis Suárez, falsely promoting an investment scheme claiming a 10,400 peso investment could yield 175,000 pesos monthly. It also reportedly uses AI-altered Telemundo footage. UTE urged the public not to share personal data, as the scam links to phishing sites posing as official sources.
Romance Scammer 'Alla Morgan' Allegedly Exploits Deepfake Technology to Defraud Victim of £17,000
A scammer, or scammers, reportedly used AI-generated deepfake videos and documents to impersonate a fictitious person named "Alla Morgan," allegedly convincing a 77-year-old woman, Nikki MacLeod, to send £17,000 through various payment methods. The deepfakes were allegedly used in establishing credibility so as to enable fraud under the pretense of an online romantic relationship.
Global Cybercrime Network Storm-2139 Allegedly Exploits AI to Generate Deepfake Content
A global cybercrime network, Storm-2139, allegedly exploited stolen credentials and developed custom tools to bypass AI safety guardrails. They reportedly generated harmful deepfake content, including nonconsensual intimate images of celebrities, and their software is reported to have disabled content moderation, hijacked AI access, and resold illicit services. Microsoft disrupted the operation and filed a lawsuit in December 2024, later identifying key members of the network in February 2025.
AI Voice Cloning of Ari Melber Allegedly Exploited in Scam Targeting Elderly Woman
A scammer allegedly impersonated MSNBC anchor Ari Melber using AI-generated voice messages and a fake social media profile to defraud a 73-year-old woman, Patricia Taylor. Over four months, the scammer reportedly manipulated her into believing they were in a relationship, ultimately convincing her to send $20,000.