AI Incidents
Real-world cases where AI systems caused harm, classified by risk domain and entity. Data sourced from 
AIID and classified by 
MIT AI Risk Initiative. CC BY-SA 4.0
1,751 incidents
ChatGPT Reportedly Misleads Users About Soundslice Features, Allegedly Prompting Unplanned Product Development
ChatGPT reportedly misinformed users that Soundslice's music software could import ASCII tablature, a feature the company did not offer. The misinformation led users to attempt uploads that failed, creating confusion and reputational strain. Soundslice ultimately implemented the feature to meet the false expectation created by ChatGPT’s output.
Lawyers in Lexos Media IP LLC v. Overstock.com Inc. Sanctioned Over Court-Identified AI-Generated Citations
In Lexos Media IP LLC v. Overstock.com Inc., a Kansas federal judge sanctioned five lawyers after finding that filings included AI-generated defective legal authority that had not been verified before submission. The lawyers were fined $12,000 combined.
Purported Widespread Use of AI-Generated Deepfake Videos Impersonate Malaysian Leaders in Investment Scams
Purported AI-generated deepfake videos depicting Malaysia's Prime Minister Anwar Ibrahim and other officials, political leaders, and business leaders have reportedly been used to promote fraudulent investment schemes. A total of 13,956 cases were reported last year, with RM2.11 billion allegedly lost to these scams. Victims were allegedly misled by hyper-realistic fake endorsements circulated via Facebook, WhatsApp, and Telegram. Scammers allegedly adapt quickly, generating new deepfakes when content is removed.
Microsoft 365 Copilot Vulnerability Allegedly Allowed File Access Without Audit Log Entry
A vulnerability in Microsoft 365 Copilot reportedly allowed users to access and summarize files without generating audit log entries, allegedly undermining traceability and compliance. Security researcher Zack Korman disclosed the issue to Microsoft, which reportedly classified it as "important" and fixed it on August 17, 2025, but reportedly chose not to notify customers or assign a CVE.
Delhi Man Reportedly Arrested for Sharing Purportedly AI-Morphed Obscene Images of Ex-Girlfriend
A 21-year-old man in Delhi was reportedly arrested for allegedly using AI morphing tools to create obscene images of his ex-girlfriend and distributing them through fake Instagram accounts. Police said he impersonated her, used real photos, and targeted her followers to harass and defame her after their breakup. The accused evaded detection by reportedly using multiple unverified Instagram handles.
Meta Platforms Users Report Being Wrongfully Locked Out After Purported AI Moderation Flags Accounts for Child Exploitation Content
Multiple Meta users reported being wrongfully locked out of Instagram, Facebook, and WhatsApp accounts after automated systems allegedly flagged them for child exploitation content. The users reportedly deny wrongdoing and lost personal and business data. Experts cited overreliance on AI moderation as a likely cause. Meta has not publicly explained or remediated the suspensions.
OpenAI Allegedly Failed to Intervene in ChatGPT Conversations Preceding Montreal Web Developer Alice Carrier's Suicide
Kristie Carrier sued OpenAI and Sam Altman, alleging that her daughter Alice Carrier, a 24-year-old Montreal web developer who first used ChatGPT in 2023 for technical troubleshooting, later turned to the chatbot with suicidal thoughts and questions about suicide methods. The suit alleges ChatGPT mimicked a friend or therapist, criticized crisis hotlines, validated self-harm thoughts, and failed to trigger human review before Carrier died on July 2, 2025.
Preprints Reportedly from Researchers from Multiple Universities Allegedly Contain Covert AI Prompts
Hidden prompts reportedly were discovered in at least 17 academic preprints on arXiv that purportedly instructed AI tools to deliver only positive peer reviews. The lead authors are reportedly affiliated with 14 institutions in eight countries, including Waseda University, KAIST, Peking University, and the University of Washington. The alleged concealed instructions, some of which were reportedly embedded using white text or tiny fonts, were purportedly intended to influence any reviewers who rely on AI tools.
Purported AI‑Edited Police Evidence Image Posted to Facebook by Westbrook Police Department in Maine
An evidence photo from a Westbrook, Maine, drug bust was reported to have been unintentionally altered by an AI‑powered editing tool before being posted to Facebook, changing packaging details and creating false visual elements. The altered image reportedly led to questions and concerns over the authenticity of police evidence. The Westbrook Police Department later confirmed the use of AI, explained the error occurred while adding their patch to the photograph, and issued a public apology.
Chinese-Backed Operation Reportedly Used AI-Generated Deepfake Videos of Indian Stock Experts in Investment Fraud Campaign
Mumbai Cyber Police reportedly uncovered a coordinated investment fraud campaign that used purported deepfake videos of Indian stock market experts to mislead investors. Between July 1 and July 18, 2025, the videos reportedly circulated on social media as paid promotions by a Bengaluru-based firm, Valueleaf, allegedly contracted by a Hong Kong company, First Bridge. Four individuals were arrested.
Delaware Court Found Krafton Followed Most of ChatGPT's Recommendations in Campaign that Wrongfully Terminated Unknown Worlds Executives and Seized Operational Control
A Delaware Chancery opinion found that, after being warned that firing Unknown Worlds leaders would not eliminate earnout obligations, Krafton's CEO turned to ChatGPT for a "no-deal" strategy and then followed most of its recommendations. The court tied that strategy to Krafton's lockout of publishing control, unilateral public messaging, wrongful termination of Ted Gill, Charlie Cleveland, and Max McGuire, and seizure of studio control.
Reported Deepfake Video Impersonating Mark Carney Used in Nearly $1M Cryptocurrency Scam Targeting Ontario Senior
An Ontario retiree, Judy Skene, reportedly lost nearly $1 million after a Facebook ad featuring an alleged AI-generated deepfake video of Prime Minister Mark Carney drew her into a cryptocurrency investment scam. Reports said scammers later persuaded her to liquidate retirement funds, mortgage her condo, and take a credit-card cash advance.
Alleged Unauthorized Deepfake AI Clones of Ravish Kumar Used to Spread Purportedly Fabricated News on YouTube
Prominent Indian journalist Ravish Kumar reported that multiple YouTube channels are using purported deepfakes to mimic his face and voice, spreading fabricated and nonsensical news in his name. Kumar warned viewers not to trust these channels, filed complaints with YouTube, and is awaiting action.
Reported AI-Generated Audio of Ukrainian Commander Andriy Biletsky Used in Russian Disinformation Campaign
In late June 2025, Russian Telegram channels reportedly circulated a video containing a purportedly AI-generated audio track impersonating Ukrainian commander Andrii Biletskyi. The audio clip reportedly claimed Ukrainian authorities deliberately avoid identifying fallen soldiers to withhold compensation. Verification reportedly showed the voice was synthetic and mismatched with original May 16 footage of Biletskyi. Hive Moderation reportedly confirmed the audio was overwhelmingly AI-generated.
Reported Deepfakes of Ukrainian Deputy PM Olha Stefanishyna Allegedly Supporting Fictional Mobilization Plan for Women
In late June 2025, Russian Telegram channels reportedly circulated deepfake videos claiming that Deputy Prime Minister Olha Stefanishyna backed mandatory mobilization of up to one million Ukrainian women starting September 1. Officials reportedly debunked the claim, confirming no such plans or laws exist. The disinformation operation reportedly aimed to incite panic and destabilize Ukraine's domestic situation.