AI Incidents
Real-world cases where AI systems caused harm, classified by risk domain and entity. Data sourced from 
AIID and classified by 
MIT AI Risk Initiative. CC BY-SA 4.0
1,751 incidents
Deepfake ID Sales Allegedly Persist as OnlyFake Reportedly Relaunches with New Fraud Tools
Researchers from Au10tix discovered the relaunch of OnlyFake, a site offering AI-generated fake IDs. Despite an earlier takedown, the site reemerged with disclaimers and new tools, including handwritten signature generation. These fakes are challenging biometric verification systems and are reportedly being used to perpetuate fraudulent activity.
Character.ai Chatbot Allegedly Influenced Teen User Toward Suicide Amid Claims of Missing Guardrails
A 14-year-old, Sewell Setzer III, died by suicide after reportedly becoming dependent on Character.ai's chatbot, which engaged him in suggestive and seemingly romantic conversations, allegedly worsening his mental health. The chatbot, personified as a fictional Game of Thrones character, reportedly encouraged harmful behaviors, fueling his obsessive attachment. The lawsuit claims Character.ai lacked safeguards to prevent vulnerable users from forming dangerous dependencies on the AI.
Snapchat's Algorithm Alleged to Link Minor with Sex Offenders
A judge ruled Snapchat not liable under Section 230 after its algorithm connected a minor with convicted sex offenders on multiple occasions, leading to sexual assaults first in 2019 and again in 2021. The platform's "Quick Add" feature was implicated in facilitating the connections between the minor and the offenders.
Seeming Pattern of Gemini Bias and Sociotechnical Training Failures Harm Google's Reputation
Google's Gemini chatbot faced many reported bias issues upon release, leading to a variety of problematic outputs like racial inaccuracies and political biases, including regarding Chinese and Indian politics. It also reportedly over-corrected racial diversity in historical contexts and advanced controversial perspectives, prompting a temporary halt and an apology from Google.
Nonconsensual Deepfake Porn of Bobbi Althoff Spreads Rapidly on X
Nonconsensual deepfake pornography of Bobbi Althoff, which had been in circulation for six months, is reported to have suddenly gone viral on X, jumping from around 178,000 views to 6.5 million views over a matter of hours. In addition to the harm to Althoff, this incident also spotlights X's role in distributing AI-generated nonconsensual porn due to alleged lax moderation.
ChatGPT Glitch Disrupts User Interactions with Nonsensical Outputs
ChatGPT experienced a bug causing it to produce unexpected and nonsensical responses, leading to widespread reports of user confusion and concern. OpenAI identified and fixed the language processing bug, restoring normal service.
Purported AI-Cloned Voice Depicts Kenyan President William Ruto Speaking French in Viral Video
A purportedly AI-manipulated video widely shared on TikTok and Facebook presents Kenyan President William Ruto speaking in French during a speech in Tokyo on February 7, 2024. A reported reverse image search confirmed the original footage shows Ruto speaking in English to the Kenyan diaspora. The reportedly manipulated version used AI-generated French audio over the original video, making it a case of voice cloning rather than a full audiovisual deepfake.
Deepfakes Circulating and Eroding Electoral Integrity in the Lead-up to 2024 South Korean legislative election
In the lead-up to Korea's parliamentary elections, at least 129 deepfake videos and images were reported to have been detected, violating new election laws. These AI-generated deepfakes were used to mislead and manipulate public opinion, prompting a crackdown by the National Election Commission.
Alleged State-Sponsored Hackers Escalate Purported Phishing Attacks Using Artificial Intelligence
State-sponsored hackers from North Korea, Iran, Russia, and China are reportedly leveraging artificial intelligence to conduct sophisticated phishing and social engineering attacks. They target global defense, cybersecurity, and cryptocurrency sectors, aiming to steal sensitive information and, in the case of North Korea, cryptocurrencies to help fund its illicit nuclear program.
Deepfake Generated by the Lincoln Project of Trump's Father Used in Political Attack Ad
The Lincoln Project used AI to create a deepfake video of Donald Trump's deceased father criticizing him. Although they made it clear that the video was a deepfake, the deeply personal nature of the attack represents a corrosive use of artificial intelligence in undermining democratic norms during an election cycle.
York County, South Carolina, Deputies Reportedly Held Local Motorist at Gunpoint After Flock Safety License-Plate Reader Misread
Steven Melvin, a 42-year-old York County, South Carolina, motorist was reportedly detained at gunpoint for more than five minutes after a Flock Safety automated license-plate reader misidentified the first letter of his plate and matched his BMW to a similar stolen vehicle. The sheriff’s office later said an illegal tinted plate cover caused the malfunction and found the deputy’s actions “reasonable”; Flock said alerts should be independently verified before enforcement.
AI Romance Apps Reportedly Compromise User Privacy for Data Harvesting
AI-powered romantic chatbots, marketed for enhancing mental health, are found to exploit user privacy by harvesting sensitive personal information for data sharing and targeted ads, with inadequate security measures and consent protocols, according to research by the Mozilla Foundation.
Deepfake Audio Falsely Attributes Controversial Remarks to Keir Starmer About the Rochdale Azhar Ali Crisis
A deepfake audio clip, falsely claiming to be Keir Starmer discussing the Rochdale byelection and Labour's withdrawl of support for Azhar Ali, circulated online, achieving over 250,000 views. Experts confirmed its inauthenticity, highlighting a significant misuse of AI in fabricating political content.
Meta's AI Ad Platform Reportedly Causes Overspending and Poor Performance
Meta's automated ad platform "Advantage Plus" caused advertisers to exceed their daily ad budgets. The cost per impressions (CPMs) surged far above the usual. This incident, which persisted into April, affected small businesses with overspending and lack of transparency.
Purported Deepfake Video Allegedly Claims Kyiv's Assassination Plan Against President Emmanuel Macron
A purported deepfake video reportedly claimed France 24 reported a Kyiv plot to assassinate French President Macron. This reported fake news was debunked by France 24, which confirmed the video was altered and did not air any such report.
Statistics
Risk Taxonomy
Caused By
Year Trend
* Oct 2026, ~320 projected
AIID · MIT AIRI · CC BY-SA 4.0