AI Incidents
Real-world cases where AI systems caused harm, classified by risk domain and entity. Data sourced from
AIID and classified by MIT AI Risk Initiative. CC BY-SA 4.0
271 incidents
Russian Center for Geopolitical Expertise Allegedly Used AI to Target U.S. Candidates with Disinformation in 2024 Election
The Moscow-based Center for Geopolitical Expertise (CGE) allegedly used AI to produce and spread deepfakes and disinformation targeting U.S. political candidates during the 2024 general election, aiming to sway public opinion and disrupt the electoral process. On December 31, 2024, the U.S. Treasury Department imposed sanctions against the CGE and its director, Valery Korovin, for their reported role in this interference.
Alleged Fake AI-Generated Christmas Card Featuring Prince Harry and Meghan Markle's Children Circulates on Social Media
An AI-generated Christmas card reportedly depicting Prince Harry and Meghan Markle’s children, Prince Archie and Princess Lilibet, was shared on social media as if it were authentic. The image is reported to have been created using older public photos and flawed AI editing.
Serbian Authorities Allegedly Used AI-Powered Cellebrite Tools to Unlock Journalist’s Phone and Install Spyware
Serbian authorities allegedly used Cellebrite's AI-powered forensic tools to unlock journalists' and activists' phones without consent. They reportedly then installed NoviSpy, a newly discovered spyware. That then purportedly allowed covert data extraction, remote microphone and camera activation, and surveillance. Amnesty International uncovered forensic evidence linking Serbia's Security Information Agency (BIA) to these attacks. Cellebrite halted sales to Serbia after the report.
Reported Deepfake Video of Elon Musk Announcing $20 Million Cryptocurrency Giveaway Circulating on Social Media
A deepfake video is reportedly circulating on social media of Elon Musk announcing a $20 million cryptocurrency giveaway beginning on December 13th, 2024. It is reported to be leading people to a fraudulent website called Elon4u.com.
Deepfake Cryptocurrency Scam Allegedly Impersonates Italian President Sergio Mattarella and Prime Minister Giorgia Meloni
A deepfake scam allegedly impersonating Italian President Sergio Mattarella and Prime Minister Giorgia Meloni circulated on various platforms. It reportedly promoted a fraudulent cryptocurrency investment scheme. The deepfakes claimed the scheme was state-backed, promising €40,000 in guaranteed income. Victims were urged to invest €250, only to lose access to funds. Italy’s Consob blocked the deceptive ads and websites, marking the first enforcement of new financial fraud regulations.
One in Six Congresswomen Have Reportedly Been Targeted by AI-Generated Nonconsensual Intimate Imagery
A study by the American Sunlight Project is reported to have found that one in six Congresswomen were targeted by AI-generated nonconsensual intimate imagery (NCII) shared on deepfake websites. The study reports having found 35,000 mentions of explicit content involving 26 members of Congress, with 25 being women. Women were 70 times more likely than men to be victimized, according to the report.
Sustained AI-Driven Russian Disinformation Campaigns Doppelgänger, Storm-1516, and Matryoshka Reportedly Disrupting German Federal Elections
Leading up to Germany’s February 23, 2025, federal election, the alleged Russian Doppelgänger, Storm-1516, and Matryoshka (Operation Overload) disinformation campaigns have reportedly been deploying AI-generated deepfake videos and fake news sites to spread false claims about German politicians and public figures. AI-powered bots have allegedly been amplifying the content across social media. Researchers suggest the campaign sought to erode trust in Germany’s democratic process. Germany's domestic intelligence agency (BfV) described the scale as unprecedented.
Names Linked to Defamation Lawsuits Reportedly Spur Filtering Errors in ChatGPT's Name Recognition
ChatGPT has reportedly been experiencing errors and service disruptions caused by hard-coded filters designed to prevent it from producing potentially harmful or defamatory content about certain individuals by blocking prompts containing specific names, likely related to post-training interventions. The reported names are Brian Hood, Jonathan Turley, Jonathan Zittrain, David Faber, David Mayer, and Guido Scorza.
Deepfake Videos Allegedly Used to Defraud Canadian Immigrants Out of Thousands of Dollars
Deepfake videos allegedly impersonated Toronto immigration lawyer Max Chaudhary, targeting Canadian immigrants via WhatsApp. The videos, appearing personal and realistic, requested thousands of dollars for legal services never rendered. Exploiting confusion caused by changing immigration rules, the scam reportedly aimed to defraud vulnerable individuals during a time of desperation and uncertainty.
Purported AI-Generated Video Depicts Trump Urging Release of Nigerian Separatist Leader Nnamdi Kanu
A reportedly AI-manipulated video circulated on social media that falsely portrayed U.S. President-elect Donald Trump calling for the release of Nigerian separatist leader Nnamdi Kanu and threatening sanctions against Nigeria. The video allegedly used old footage paired with AI-generated audio mimicking Trump's voice. Fact-checkers identified the video as inauthentic, noting mismatched lip-sync, fabricated quotes, and the fictitious date of "November 31st."
AI-Generated Airline Reviews Allegedly Mislead Consumers and Undermine Trust
AI-generated reviews of airline services have reportedly increased by 189% since the release of ChatGPT, with certain carriers like China Southern Airlines and SouthWest Airlines disproportionately affected, according to a study by Originality.ai.
Blogger Milagro Gramz Allegedly Promoted AI-Generated Pornographic Deepfake Targeting Megan Thee Stallion
A blogger, Milagro Gramz, was reportedly found liable for promoting and amplifying a sexually explicit AI-generated deepfake depicting rapper Megan Thee Stallion as part of an online harassment campaign linked to misinformation about her 2020 shooting. Court filings alleged the blogger encouraged followers to view the altered content and spread defamatory claims. In December 2025, a federal jury reportedly awarded damages for harassment and promotion of the deepfake.
Purported AI-Generated Content Circulates Widely in Sudan Amid Civil Conflict and Information Vacuum
Purported AI-generated deepfakes have circulated widely on Sudanese social media during the ongoing conflict, allegedly spreading false claims, impersonating public figures, and distorting political discourse. Reported incidents include fabricated videos and audio used to mislead or satirize, some of which gained traction among journalists and officials. Observers warn that poor detection tools and limited moderation may be enabling the manipulation of public trust.
Video with Reportedly AI-Generated Media Purported to Show Croatian Physician Alemka Markotić Endorsing Hondrosol After False Murder Claim on Facebook
A Facebook video purported to show Croatian infectious-disease physician Alemka Markotić and TV host Zoran Šprajc discussing her supposed murder and endorsing a joint-pain product called Hondrosol. The clip and linked article were reported to use AI-generated or manipulated media and to mimic Croatian government branding, directing users toward a scam purchase page.
Purported Deepfake Allegedly Misattributes Claims to Former Student in Attack on Vice-Presidential Candidate Tim Walz
A purported viral deepfake accused Democratic vice-presidential nominee Tim Walz of misconduct by using the stolen identity of former student Matthew Metro. Circulated on X and other platforms, the video reportedly reached millions before being flagged for manipulation. U.S. intelligence later revealed it and three other similar events were part of the Russian disinformation campaign Storm-1516, whose aim is to disrupt the 2024 elections.