AI Incidents
Real-world cases where AI systems caused harm, classified by risk domain and entity. Data sourced from
AIID and classified by MIT AI Risk Initiative. CC BY-SA 4.0
197 incidents
Purportedly AI-Generated Deepfake Reportedly Used to Impersonate DNB Bank CFO and CEO in Live Teams Meeting
Unknown cybercriminals reportedly used purported deepfakes to impersonate DNB Bank's CFO and CEO during a live Microsoft Teams meeting, instructing employees at the bank's Singapore office to transfer millions of Singapore dollars. The video and voice were allegedly cloned from public footage and appeared convincing. DNB identified the attempt as a "CEO fraud" and avoided losses, calling it their first encounter with a live deepfake meeting.
Purported AI-Manipulated News Clip Fabricates Explosion and Doctor's Murder Plot for Scam
A purported AI-manipulated video falsely showing Citizen TV anchor Swaleh Mdoe reporting on the bombing of a Kenyan doctor's home circulated widely on Facebook. The video reportedly used AI-generated audio and visuals to fabricate a conspiracy in which pharmaceutical companies targeted the doctor for promoting a "miracle cure." In reality, the explosion footage was from Ohio, the doctor was fictitious, and the content aimed to manipulate viewers into purchasing an unproven health product.
Alleged AI-Driven Phishing Scam Impersonates Maine Town Official to Falsely Request $22,500
An alleged AI-generated phishing email targeted a resident of Gray, Maine, falsely claiming to be from the town’s planning department. The alleged email, bearing a fake signature and official-looking letterhead, requested $22,500 for a zoning board meeting. Town officials have reportedly warned residents of increasing risks posed by AI-enabled scams, emphasizing that the town does not accept electronic payments and urging vigilance against similar fraudulent emails.
Tennessee Meteorologist's Likeness Reportedly Used in Sextortion Campaign Involving Purported AI-Generated Content
Bree Smith, a meteorologist in Nashville, Tennessee, was reportedly targeted in a sextortion campaign involving purported AI-generated deepfakes that manipulated her likeness into explicit content. According to reporting, Smith's face was digitally placed onto semi-nude and nude bodies, with the resulting media circulated online by impersonators seeking money. Smith documented the spread of these accounts and has advocated for legislative responses, including a new Tennessee bill addressing deepfake-related harms.
Russian Center for Geopolitical Expertise Allegedly Used AI to Target U.S. Candidates with Disinformation in 2024 Election
The Moscow-based Center for Geopolitical Expertise (CGE) allegedly used AI to produce and spread deepfakes and disinformation targeting U.S. political candidates during the 2024 general election, aiming to sway public opinion and disrupt the electoral process. On December 31, 2024, the U.S. Treasury Department imposed sanctions against the CGE and its director, Valery Korovin, for their reported role in this interference.
ChatGPT Reportedly Referenced During Las Vegas Cybertruck Explosion Planning
Matthew Livelsberger, the suspect in the 2025 Las Vegas Cybertruck explosion, reportedly used ChatGPT to search for publicly available information on explosives, ammunition, and fireworks regulations. ChatGPT is alleged to have played a role in the planning of the explosion outside the Trump International Hotel in Las Vegas. The information provided by ChatGPT, though, was reportedly general and available through other public sources.
Alleged Fake AI-Generated Christmas Card Featuring Prince Harry and Meghan Markle's Children Circulates on Social Media
An AI-generated Christmas card reportedly depicting Prince Harry and Meghan Markle’s children, Prince Archie and Princess Lilibet, was shared on social media as if it were authentic. The image is reported to have been created using older public photos and flawed AI editing.
Serbian Authorities Allegedly Used AI-Powered Cellebrite Tools to Unlock Journalist’s Phone and Install Spyware
Serbian authorities allegedly used Cellebrite's AI-powered forensic tools to unlock journalists' and activists' phones without consent. They reportedly then installed NoviSpy, a newly discovered spyware. That then purportedly allowed covert data extraction, remote microphone and camera activation, and surveillance. Amnesty International uncovered forensic evidence linking Serbia's Security Information Agency (BIA) to these attacks. Cellebrite halted sales to Serbia after the report.
Reported Deepfake Video of Elon Musk Announcing $20 Million Cryptocurrency Giveaway Circulating on Social Media
A deepfake video is reportedly circulating on social media of Elon Musk announcing a $20 million cryptocurrency giveaway beginning on December 13th, 2024. It is reported to be leading people to a fraudulent website called Elon4u.com.
Deepfake Cryptocurrency Scam Allegedly Impersonates Italian President Sergio Mattarella and Prime Minister Giorgia Meloni
A deepfake scam allegedly impersonating Italian President Sergio Mattarella and Prime Minister Giorgia Meloni circulated on various platforms. It reportedly promoted a fraudulent cryptocurrency investment scheme. The deepfakes claimed the scheme was state-backed, promising €40,000 in guaranteed income. Victims were urged to invest €250, only to lose access to funds. Italy’s Consob blocked the deceptive ads and websites, marking the first enforcement of new financial fraud regulations.
One in Six Congresswomen Have Reportedly Been Targeted by AI-Generated Nonconsensual Intimate Imagery
A study by the American Sunlight Project is reported to have found that one in six Congresswomen were targeted by AI-generated nonconsensual intimate imagery (NCII) shared on deepfake websites. The study reports having found 35,000 mentions of explicit content involving 26 members of Congress, with 25 being women. Women were 70 times more likely than men to be victimized, according to the report.
Sustained AI-Driven Russian Disinformation Campaigns Doppelgänger, Storm-1516, and Matryoshka Reportedly Disrupting German Federal Elections
Leading up to Germany’s February 23, 2025, federal election, the alleged Russian Doppelgänger, Storm-1516, and Matryoshka (Operation Overload) disinformation campaigns have reportedly been deploying AI-generated deepfake videos and fake news sites to spread false claims about German politicians and public figures. AI-powered bots have allegedly been amplifying the content across social media. Researchers suggest the campaign sought to erode trust in Germany’s democratic process. Germany's domestic intelligence agency (BfV) described the scale as unprecedented.
Deepfake Videos Allegedly Used to Defraud Canadian Immigrants Out of Thousands of Dollars
Deepfake videos allegedly impersonated Toronto immigration lawyer Max Chaudhary, targeting Canadian immigrants via WhatsApp. The videos, appearing personal and realistic, requested thousands of dollars for legal services never rendered. Exploiting confusion caused by changing immigration rules, the scam reportedly aimed to defraud vulnerable individuals during a time of desperation and uncertainty.
Purported AI-Generated Video Depicts Trump Urging Release of Nigerian Separatist Leader Nnamdi Kanu
A reportedly AI-manipulated video circulated on social media that falsely portrayed U.S. President-elect Donald Trump calling for the release of Nigerian separatist leader Nnamdi Kanu and threatening sanctions against Nigeria. The video allegedly used old footage paired with AI-generated audio mimicking Trump's voice. Fact-checkers identified the video as inauthentic, noting mismatched lip-sync, fabricated quotes, and the fictitious date of "November 31st."
AI-Generated Airline Reviews Allegedly Mislead Consumers and Undermine Trust
AI-generated reviews of airline services have reportedly increased by 189% since the release of ChatGPT, with certain carriers like China Southern Airlines and SouthWest Airlines disproportionately affected, according to a study by Originality.ai.