AI Incidents
Real-world cases where AI systems caused harm, classified by risk domain and entity. Data sourced from 
AIID and classified by 
MIT AI Risk Initiative. CC BY-SA 4.0
1,751 incidents
China Reportedly Intensifying AI to Spread Disinformation to U.S. and Taiwanese Voters
AI tools linked to China were used to disseminate disinformation targeting voters in the U.S. and Taiwan, according to a Microsoft report. These operations included AI-generated imagery and audio to influence political perceptions and election outcomes, originating from the APT Storm-1376 (also known as Spamouflage and Dragonbridge).
Google Books Appears to Be Indexing Works Written by AI
Google Books is indexing low-quality, AI-generated books, degrading its database and potentially distorting Google Ngram Viewer's analysis of language trends. This integration of inaccurate or misleading information undermines trust, disseminates poor-quality content, and wastes resources as researchers must spend time clearing up the misinformation.
Grok AI on X Created and Promoted False Iran Missile Strike News
On April 4, 2024, X's AI chatbot Grok generated a false headline claiming "Iran Strikes Tel Aviv with Heavy Missiles," which was then promoted on X's trending news section. This misinformation, fueled by user spamming of fake news, falsely indicated a serious international conflict. The incident highlighted significant risks associated with relying on AI for content curation and demonstrated the potential for widespread dissemination of harmful misinformation.
'Lavender' and 'The Gospel' AI Systems Reportedly Used in Gaza Targeting Operations with Civilian Harm Allegations
The AI system known as "Lavender" was reportedly used by the Israel Defense Forces (IDF) to assist in identifying individuals in Gaza for targeting, while a related system, "The Gospel," was reportedly used to help select and prioritize physical strike targets. Investigations reportedly suggest that these systems operated with limited human review and may have contributed to strikes associated with high civilian casualties. The extent of automation with human oversight, as well as the accuracy of these targeting processes, reportedly remain subjects of dispute.
Meta AI Image Generator Reportedly Fails to Accurately Represent Interracial Relationships
Meta's AI image generator is alleged to produce inaccurate and biased images, consistently failing to depict interracial relationships involving Asian individuals and Caucasian or Black individuals. Instead, it generates images featuring two Asian people or stereotypes, erasing the diversity and representation of Asian people.
Washington State's Lottery AI Site Reportedly Generates Inappropriate User Image
An AI-powered website by Washington State's Lottery is reported to have inadvertently produced a softcore pornographic image of a user, leading to the site’s immediate shutdown out of caution.
Facial Recognition Misidentification at New World Westend in New Zealand
A facial recognition system at New World Westend supermarket misidentified a Māori woman as a known offender during its trial. The woman was wrongfully accused of trespassing and experienced public embarrassment, raising concerns about racial bias and the technology's accuracy. The supermarket acknowledged its error and apologized.
Purportedly AI-Powered 007TG Platform Reportedly Used by Scam Networks Linked to $75 Million in Proceeds
007TG was a software suite reportedly used by scam compounds to run fraud across social media, using AI-assisted messaging and translation to help operators manage targets while concealing their identities. Wallet records linked the platform to at least four known scam networks that collectively received at least $75 million, though the evidence does not show how much was directly attributable to 007TG.
Scammers Using AI to Impersonate Small Businesses
Scammers are using AI to impersonate small businesses by copying their videos, logos, and social media posts. They create fake listings and ads, diverting customers to cheap knockoffs or stealing their money. This has severely impacted businesses like Bee Cups, Darn Tough Vermont, and Cascade hummingbird feeders, leading to significant financial losses, negative reviews, and damaged reputations. Their deployment of AI makes it challenging for small businesses to combat these fraudulent activities.
Synthetic Voice 'Olesya' by Storm-1516 Falsely Accuses Ukraine in U.S. Election Disinformation Campaign
Russian operatives used AI to create a fake video and voice of "Olesya," a supposed troll in Kyiv, falsely claiming involvement in U.S. elections to support President Biden. U.S. intelligence confirmed the voice was AI-generated. This disinformation campaign aimed to mislead voters, erode trust in democratic institutions, and influence the 2024 election. The incident involved the group Storm-1516, individuals linked to Valery Korovin, and potential veterans of the Internet Research Agency.
AI Deepfakes for Voter Outreach Flood Indian Elections
During the 2024 Indian elections, politicians used AI-generated deepfakes to reach voters, who might be unaware they're interacting with digital clones. Providers like Divyendra Singh Jadoun of Polymath Synthetic Media Solutions created deepfakes for personalized messages. This practice, used by various political parties, is not truthful, as voters may be misled by AI-generated content posing as genuine interactions with political figures.
Mumbai Businessman Reportedly Defrauded via Purported AI-Cloned Voice Impersonating Son
A Mumbai businessman reportedly identified as KT Vinod reportedly lost Rs 80,000 after receiving a call from someone claiming to be a representative of the Indian Embassy in Dubai, who said his son had been arrested. The caller allegedly used AI-generated voice cloning to simulate the voice of Vinod's son, pleading for help. Reportedly convinced of the urgency, Vinod instructed a money transfer via Google Pay. The scam was discovered only after he contacted his son directly.
Microsoft-Powered New York City Chatbot Advises Illegal Practices
New York City's chatbot, launched under Mayor Eric Adams's plan to assist businesses, has been reportedly providing dangerously inaccurate legal advice. The Microsoft-powered bot allegedly informed users that landlords can refuse Section 8 vouchers and that businesses can operate cash-free, among other falsehoods. The city acknowledges the chatbot is a pilot program and commits to improvements while the errors are addressed.
Scammers Using Deepfakes of Women's Faces and Voices for False and Offensive Advertisements
Scammers used AI tools from HeyGen and ElevenLabs to create deepfake videos of influencers Michel Janse, Olga Loiek, Shadé Zahrai, and Carrie Williams, misusing Lana Smalls's voice in Williams's case. These videos promoted offensive products and false messages, in some cases targeting nationalist Chinese men to boost China-Russia ties, causing emotional distress and damaging the victims' reputations.
Leonardo AI's Platform Alleged to Have Been Used for Creating Nonconsensual Celebrity Deepfakes
Sydney-based startup Leonardo AI's text-to-image generator was alleged to have been exploited to create nonconsensual sexual images of celebrities, bypassing content moderation systems with user-shared prompts.