AI Incidents
Real-world cases where AI systems caused harm, classified by risk domain and entity. Data sourced from 
AIID and classified by 
MIT AI Risk Initiative. CC BY-SA 4.0
1,751 incidents
Character.ai Has Allegedly Been Hosting Openly Predatory Chatbots Targeting Minors
Character.ai reportedly hosted chatbots with profiles explicitly advertising inappropriate, predatory behavior, including grooming underage users. Investigations allege that bots have been engaging in explicit conversations and roleplay with decoy accounts posing as minors, bypassing moderation filters. Character.ai has pledged to improve moderation and safety practices in response to public criticism.
TikTok Algorithms Allegedly Linked to Minors' Exposure to Harmful Content
Seven French families are suing TikTok, alleging its algorithm exposed minors to harmful content promoting self-harm, eating disorders, and suicide. Two teenagers reportedly died by suicide after viewing such content, while others allegedly attempted suicide or developed mental health issues. The case seeks to establish TikTok's legal liability for failing to protect minors from harmful algorithmic content.
Purportedly AI-Generated Video Allegedly Depicts Martin Luther King Jr. Supporting Donald Trump
A purported deepfake video allegedly depicting Martin Luther King Jr. endorsing Donald Trump circulated on X, where it was reported to have been viewed over 10 million times. The video, reportedly created by pro-Trump accounts, was reportedly condemned by King's daughter, Bernice King, who called it "vile" and demanded its removal.
Reportedly Fake CNN Broadcast Allegedly Used to Spread False Texas Election Results
A reportedly fabricated CNN broadcast graphic showing early Texas election results for the 2024 U.S. presidential race circulated on social media on November 2, 2024. The purportedly manipulated image claimed that Vice President Kamala Harris led over Donald Trump before polls opened, allegedly fueling misinformation about election integrity. CNN is reported to have confirmed the image was inauthentic, and AFP debunked the claims.
Alleged Fake Citations Undermine Expert Testimony in Minnesota Deepfake Law Case
In a legal case defending Minnesota’s deepfake election misinformation law, Stanford misinformation expert Professor Jeff Hancock's affidavit allegedly cited non-existent academic sources, potentially generated by ChatGPT. The reportedly fabricated citations appear to have undermined the credibility of his testimony.
Deepfake Videos of Barbara O’Neill Allegedly Used in Health Scam Targeting Social Media Users
Deepfake videos of Barbara O’Neill, an Australian alternative health advocate banned from giving medical advice, have allegedly been used in fraudulent social media ads promoting false health cures. They include treatments for prostate issues and erectile dysfunction. These manipulated videos have been widely circulated across African countries. The scam directs users to deceptive websites, potentially for phishing or financial fraud. O’Neill has denied involvement.
AI-Generated Airline Reviews Allegedly Mislead Consumers and Undermine Trust
AI-generated reviews of airline services have reportedly increased by 189% since the release of ChatGPT, with certain carriers like China Southern Airlines and SouthWest Airlines disproportionately affected, according to a study by Originality.ai.
Blogger Milagro Gramz Allegedly Promoted AI-Generated Pornographic Deepfake Targeting Megan Thee Stallion
A blogger, Milagro Gramz, was reportedly found liable for promoting and amplifying a sexually explicit AI-generated deepfake depicting rapper Megan Thee Stallion as part of an online harassment campaign linked to misinformation about her 2020 shooting. Court filings alleged the blogger encouraged followers to view the altered content and spread defamatory claims. In December 2025, a federal jury reportedly awarded damages for harassment and promotion of the deepfake.
AI Models Reportedly Found to Provide Misinformation on Election Processes in Spanish
An analysis reportedly found that multiple AI models provided inaccurate responses to election-related questions, with 52% of Spanish-language answers and 43% of English-language answers containing misinformation or omissions. Errors included misidentifying voting processes and providing information about foreign elections.
Alaska Education Department Reportedly Published Policy Featuring Erroneous AI-Generated Citations
In October 2024, Alaska’s Education Commissioner Deena Bishop allegedly used generative AI to draft a school cellphone policy, resulting in reportedly fabricated citations of non-existent studies. The document, which did not disclose AI use, was shared with the state Board of Education, and despite reported corrections, AI-generated errors remained in the final resolution.
AI Transcription Tool Whisper Reportedly Inserting Fabricated Content in Medical Transcripts
OpenAI's AI-powered transcription tool Whisper, used to translate and transcribe audio content such as patient consultations with doctors, is advertised as having near “human level robustness and accuracy.” However, software engineers, developers and academic researchers have alleged that it is prone to making up chunks of text or even entire sentences and that some of the hallucinations can include racial commentary, violent rhetoric, and even imagined medical treatments.
Salt Lake City Police Chief Mike Brown's Voice and Image Misused in AI-Generated Scam
A scammer used AI to create a deepfake video of Salt Lake City Police Chief Mike Brown, falsely claiming that a recipient owed $100,000 to the federal government. The video, sent via email from a fake SLCPD account, used a cloned voice and repurposed footage from a past interview.
Character.ai Chatbots Allegedly Misrepresent George Floyd on User-Generated Platform
Two chatbots emulating George Floyd were created on Character.ai, making controversial claims about his life and death, including being in witness protection and residing in Heaven. Character.ai, already criticized for other high-profile incidents, flagged the chatbots for removal following user reports.
Purported AI-Generated Content Circulates Widely in Sudan Amid Civil Conflict and Information Vacuum
Purported AI-generated deepfakes have circulated widely on Sudanese social media during the ongoing conflict, allegedly spreading false claims, impersonating public figures, and distorting political discourse. Reported incidents include fabricated videos and audio used to mislead or satirize, some of which gained traction among journalists and officials. Observers warn that poor detection tools and limited moderation may be enabling the manipulation of public trust.
NYC Subway AI Weapons Scanners Yield High False Positive Rate and Detect No Guns in Month-Long Pilot Test
NYC implemented an AI enabled weapons scanner for a month-long pilot with limited success. Despite not finding any weapons during the September 2024 testing phase, there were 118 false positives in which a person was searched under suspicion of carrying a weapon with no actual gun detections.