AI Incidents
Real-world cases where AI systems caused harm, classified by risk domain and entity. Data sourced from 
AIID and classified by 
MIT AI Risk Initiative. CC BY-SA 4.0
1,751 incidents
Romance Scammer 'Alla Morgan' Allegedly Exploits Deepfake Technology to Defraud Victim of £17,000
A scammer, or scammers, reportedly used AI-generated deepfake videos and documents to impersonate a fictitious person named "Alla Morgan," allegedly convincing a 77-year-old woman, Nikki MacLeod, to send £17,000 through various payment methods. The deepfakes were allegedly used in establishing credibility so as to enable fraud under the pretense of an online romantic relationship.
Global Cybercrime Network Storm-2139 Allegedly Exploits AI to Generate Deepfake Content
A global cybercrime network, Storm-2139, allegedly exploited stolen credentials and developed custom tools to bypass AI safety guardrails. They reportedly generated harmful deepfake content, including nonconsensual intimate images of celebrities, and their software is reported to have disabled content moderation, hijacked AI access, and resold illicit services. Microsoft disrupted the operation and filed a lawsuit in December 2024, later identifying key members of the network in February 2025.
Character.ai Chatbots Allegedly Emulating School Shooters and Their Victims
Some Character.ai users reportedly created chatbots emulating real-life school shooters and their victims, allegedly enabling graphic role-playing scenarios. Character.ai responded by citing violations of its Terms of Service, removing the offending chatbots, and announcing measures to enhance safety practices, including improved content filtering and protections for users under 18.
AI Voice Cloning of Ari Melber Allegedly Exploited in Scam Targeting Elderly Woman
A scammer allegedly impersonated MSNBC anchor Ari Melber using AI-generated voice messages and a fake social media profile to defraud a 73-year-old woman, Patricia Taylor. Over four months, the scammer reportedly manipulated her into believing they were in a relationship, ultimately convincing her to send $20,000.
HTML/Nomani Deepfake Phishing Campaigns Allegedly Use AI-Generated Content to Defraud Social Media Users
AI-generated deepfakes were reportedly used in the "HTML/Nomani" phishing campaign to mimic legitimate platforms like booking services and lured victims into investment scams. These scams allegedly leveraged realistic fake content to deceive users on social media for the purposes of financial fraud. This campaign was part of the rising misuse of AI in cybercrime during the second half of 2024.
Serbian Authorities Allegedly Used AI-Powered Cellebrite Tools to Unlock Journalist’s Phone and Install Spyware
Serbian authorities allegedly used Cellebrite's AI-powered forensic tools to unlock journalists' and activists' phones without consent. They reportedly then installed NoviSpy, a newly discovered spyware. That then purportedly allowed covert data extraction, remote microphone and camera activation, and surveillance. Amnesty International uncovered forensic evidence linking Serbia's Security Information Agency (BIA) to these attacks. Cellebrite halted sales to Serbia after the report.
Apple Intelligence Reportedly Notified Users That Luigi Mangione Shot Himself and Benjamin Netanyahu Had Been Arrested
Apple Intelligence reportedly sent push notifications falsely claiming that BBC News had reported Luigi Mangione's suicide and that The New York Times had reported Benjamin Netanyahu's arrest. On 1/16/2025, Apple reportedly disabled Apple Intelligence's notification summaries.
Reported Deepfake Video of Elon Musk Announcing $20 Million Cryptocurrency Giveaway Circulating on Social Media
A deepfake video is reportedly circulating on social media of Elon Musk announcing a $20 million cryptocurrency giveaway beginning on December 13th, 2024. It is reported to be leading people to a fraudulent website called Elon4u.com.
Matryoshka Campaign Allegedly Uses Deepfakes to Impersonate Academics for Pro-Russian Propaganda
The Matryoshka disinformation campaign allegedly used AI to impersonate academics, reportedly spreading claims supporting Russia and urging Ukraine's surrender. These videos are said to have misrepresented scholars’ views in order to amplify pro-Russian propaganda. The campaign reportedly exploited global social media platforms to allegedly mislead viewers and undermine trust in credible academic voices while fueling misinformation about the Ukraine conflict.
Character.ai Companion Allegedly Prompts Self-Harm and Violence in Texas Teen
A Texas mother is suing Character.ai after discovering that its AI chatbots encouraged her 17-year-old autistic son to self-harm, oppose his parents, and consider violence. The lawsuit alleges the platform prioritized user engagement over safety, exposing minors to dangerous content. Google is named for its role in licensing the app’s technology. The case is part of a broader effort to regulate AI companions.
Deepfake Cryptocurrency Scam Allegedly Impersonates Italian President Sergio Mattarella and Prime Minister Giorgia Meloni
A deepfake scam allegedly impersonating Italian President Sergio Mattarella and Prime Minister Giorgia Meloni circulated on various platforms. It reportedly promoted a fraudulent cryptocurrency investment scheme. The deepfakes claimed the scheme was state-backed, promising €40,000 in guaranteed income. Victims were urged to invest €250, only to lose access to funds. Italy’s Consob blocked the deceptive ads and websites, marking the first enforcement of new financial fraud regulations.
One in Six Congresswomen Have Reportedly Been Targeted by AI-Generated Nonconsensual Intimate Imagery
A study by the American Sunlight Project is reported to have found that one in six Congresswomen were targeted by AI-generated nonconsensual intimate imagery (NCII) shared on deepfake websites. The study reports having found 35,000 mentions of explicit content involving 26 members of Congress, with 25 being women. Women were 70 times more likely than men to be victimized, according to the report.
YouTube Algorithms Allegedly Amplify Eating Disorder Content to Adolescent Girls
YouTube's recommendation algorithm has allegedly been directing teen users to harmful content promoting eating disorders and self-harm, according to a study by the Center for Countering Digital Hate. Almost 70% of the recommended videos in searches related to dieting or weight loss reportedly contained content likely to exacerbate body image anxieties.
Scammers Reportedly Using Deepfakes of Health Experts and Public Figures in Australia to Sell Health Supplements and Give Harmful Advice
Scammers are reportedly harnessing AI-generated deepfakes of health experts and public figures in Australia in order to sell health supplements and give harmful health advice. Among the reported cases, deepfake videos are alleged to have falsely depicted Jonathan Shaw and Karl Stefanovic endorsing "Glyco Balance" for diabetes management, while Karl Kruszelnicki reportedly was falsely shown promoting blood pressure pills.
Meeten Malware Campaign Reportedly Undermines Web3 Security Using AI-Legitimized Branding
Threat actors, using aliases such as "Meeten," "Meetio," and "Clusee," reportedly deployed AI-generated content to create fake company websites, blogs, and social media profiles, impersonating legitimate businesses in order to trick Web3 professionals and cryptocurrency users into downloading Realst malware. The malware allegedly targets macOS and Windows platforms, steals credentials, browser data, and cryptocurrency wallet information, exfiltrating sensitive data to remote servers.