AI Incidents
Real-world cases where AI systems caused harm, classified by risk domain and entity. Data sourced from 
AIID and classified by 
MIT AI Risk Initiative. CC BY-SA 4.0
566 incidents
Purported Deepfake Facebook Advertisement Reportedly Used Bulgarian Actor, Director, and Playwright Kamen Donev's Likeness to Market Joint-Pain Product
A reportedly AI-manipulated Facebook advertisement appeared to repurpose footage of Bulgarian actor, director, and playwright Kamen Donev, allegedly overlaying fabricated audio and altered lip movements to market a purported joint-pain product. The ad reportedly linked to a presumably fabricated article imitating a Bulgarian news outlet and to an online sales funnel for a product described as unavailable through pharmacies.
Kenyan Journalist Jeff Koinange Depicted Endorsing Gambling App in Purported AI-Generated Deepfake
A viral video purportedly manipulated by AI shows Kenyan journalist Jeff Koinange endorsing a mobile gambling app. The video was reportedly created using AI deepfake techniques, uses footage from a legitimate news broadcast, and artificially alters Koinange's voice and mouth movements. Neither Koinange nor Citizen TV has promoted the app, and no legitimate source hosts the video.
Alleged Deepfake Audio Depicts Philippines President Ferdinand Marcos Jr. Ordering Military Action
A purported deepfake audio clip portraying Philippine President Ferdinand Marcos Jr. ordering an attack on China spread online in July 2024, fueling tensions in the West Philippine Sea. The Presidential Communications Office reportedly debunked it as fake, attributing it to foreign actors.
Child Predators Are Reportedly Generating Deepfake Nudes of Children to Extort Them
Internet Watch Foundation (IWF) has reported that it has found a manual on the dark web that encourages criminals to use "nudifying" AI tools to depict children naked in order to extort victims into providing graphic content.
Unauthorized Use of AI to Replicate Tupac Shakur's and Snoop Dogg's Voices in Drake's 'Taylor Made Freestyle'
Drake released a song, "Taylor Made Freestyle," featuring AI-generated voices of Tupac Shakur and Snoop Dogg. The unauthorized replication of Tupac’s voice without the estate's consent led to a cease-and-desist order.
Amandine Le Pen Deepfake Account Misleads Thousands on TikTok
A TikTok account, "Amandine Le Pen," created using AI deepfake technology, impersonated a fictional niece of Marine Le Pen, amassing over 30,000 followers. The account spread pro-RN messages and solicited donations, misleading users and exploiting political influence. Visual inconsistencies revealed the deepfake, raising concerns about AI misuse for political manipulation, identity theft, and violation of personal rights, especially with similar accounts proliferating, such as "Lena Maréchal Lepen."
Deepfake of Former Prime Minister of Malta Joseph Muscat Allegedly Promotes Nord Invest Scam
A reported doctored video falsely depicts former Maltese Prime Minister Joseph Muscat promoting the crypto platform Nord Invest. The manipulated footage, originally from a 2013 Sky News interview, was overlaid with AI-generated audio to mimic Muscat’s voice endorsing a fraudulent scheme. The video was reportedly shared through Facebook.
Reported Audio Deepfake Impersonating CEO Karim Toubba Targets LastPass Employee via WhatsApp
A LastPass employee was reportedly targeted by an audio deepfake impersonating CEO Karim Toubba via WhatsApp. The message used voice-cloning AI in a social engineering attempt to create urgency and bypass security protocols. The employee recognized red flags, reported the incident, and no breach occurred. LastPass shared the incident publicly to raise awareness about deepfake-driven fraud campaigns targeting executives and companies.
Deepfake Porn Sites Use Breeze Liu's Image Without Consent
Porn sites are alleged to have used AI-generated images of Breeze Liu without her consent, leading to severe emotional distress. Liu discovered a video of herself on Pornhub, which was then deepfaked and spread across over 800 links. Despite efforts to remove the content, many sites refused to comply, perpetuating the violation and exploitation of her image.
TikTok Hosts AI-Generated English-Language Hitler Speeches with Millions of Views
AI-generated English-language Adolf Hitler speeches have been proliferating on TikTok. They are reportedly accumulating millions of views despite violating the platform’s hate speech policies. The clips are described as often pairing the audio with misleading translations and memes that glorify Hitler and distort historical facts. While some content has been removed, many accounts reportedly continue to post similar videos.
Reportedly Viral AI-Generated Song about 'Diddy Party' Allegedly Mimics Justin Bieber
A purportedly AI-generated song imitating Justin Bieber's voice, allegedly referencing a "Diddy party," spread widely across social media, reportedly leading fans to believe it was authentic. Experts reportedly identified the audio as likely AI-made, citing frequency mismatches and digital artifacts. The reportedly viral song misrepresented Bieber, posing potential brand and revenue impacts for the artist while misleading listeners.
China Reportedly Intensifying AI to Spread Disinformation to U.S. and Taiwanese Voters
AI tools linked to China were used to disseminate disinformation targeting voters in the U.S. and Taiwan, according to a Microsoft report. These operations included AI-generated imagery and audio to influence political perceptions and election outcomes, originating from the APT Storm-1376 (also known as Spamouflage and Dragonbridge).
'Lavender' and 'The Gospel' AI Systems Reportedly Used in Gaza Targeting Operations with Civilian Harm Allegations
The AI system known as "Lavender" was reportedly used by the Israel Defense Forces (IDF) to assist in identifying individuals in Gaza for targeting, while a related system, "The Gospel," was reportedly used to help select and prioritize physical strike targets. Investigations reportedly suggest that these systems operated with limited human review and may have contributed to strikes associated with high civilian casualties. The extent of automation with human oversight, as well as the accuracy of these targeting processes, reportedly remain subjects of dispute.
Scammers Using AI to Impersonate Small Businesses
Scammers are using AI to impersonate small businesses by copying their videos, logos, and social media posts. They create fake listings and ads, diverting customers to cheap knockoffs or stealing their money. This has severely impacted businesses like Bee Cups, Darn Tough Vermont, and Cascade hummingbird feeders, leading to significant financial losses, negative reviews, and damaged reputations. Their deployment of AI makes it challenging for small businesses to combat these fraudulent activities.
Synthetic Voice 'Olesya' by Storm-1516 Falsely Accuses Ukraine in U.S. Election Disinformation Campaign
Russian operatives used AI to create a fake video and voice of "Olesya," a supposed troll in Kyiv, falsely claiming involvement in U.S. elections to support President Biden. U.S. intelligence confirmed the voice was AI-generated. This disinformation campaign aimed to mislead voters, erode trust in democratic institutions, and influence the 2024 election. The incident involved the group Storm-1516, individuals linked to Valery Korovin, and potential veterans of the Internet Research Agency.