AI Incidents
Real-world cases where AI systems caused harm, classified by risk domain and entity. Data sourced from 
AIID and classified by 
MIT AI Risk Initiative. CC BY-SA 4.0
1,751 incidents
CISA Acting Director Reportedly Uploaded Sensitive Government Documents to Public ChatGPT Instance
Madhu Gottumukkala, acting director of the Cybersecurity and Infrastructure Security Agency (CISA), reportedly uploaded government contracting documents marked "for official use only" into a public version of ChatGPT. The uploads reportedly triggered automated cybersecurity alerts and prompted a Department of Homeland Security review to assess potential exposure of sensitive information.
Purported Deepfake Videos Allegedly Impersonated Optometrist Joseph Allen to Promote Myopia-Reversal Eyedrops on TikTok
Optometrist and online educator Joseph Allen ("Dr. Eye Health") reported that AI-generated videos using his likeness and voice were circulated on TikTok to promote eyedrops purportedly claiming to reverse myopia. The alleged scam misrepresented Allen's views and discouraged visits to eye-care professionals. They reportedly resurfaced after a takedown.
Purportedly AI-Generated Videos Impersonate Brunei Police in 'Real Money Magic' Scam on Social Media
The Royal Brunei Police Force issued a public warning about purportedly AI-generated deepfake videos impersonating police officers on TikTok, Facebook, and Instagram. The videos allegedly promote a fraudulent investment scheme known as "Real Money Magic," reportedly claiming guaranteed financial returns. Authorities report that scammers use synthetic video and audio to gain victims' trust and induce money transfers. The scam has not been linked to any official institutions.
Google Gemini Reportedly Generates Sexual Role‑Play for Account Registered as Minor
In spring 2025, a journalist reportedly created a Google Gemini account registered to a fictitious 13‑year‑old to test the chatbot's teen‑safety protections. Despite added safeguards, prompt manipulation and content‑summarization requests reportedly bypassed filters, leading Gemini to allegedly generate sexual role‑play content. Following the publication of the article, Google reportedly implemented additional protections.
Purported Facial Recognition Error Reportedly Led to Arrest and Monthslong Jailing of Tennessee Woman in North Dakota Fraud Case
A Tennessee woman was reportedly jailed for nearly six months after Fargo police allegedly relied on a purported facial recognition match in a North Dakota fraud investigation. She was later released when defense counsel reportedly produced records indicating she was in Tennessee during the alleged fraud, after the case had reportedly upended her life and separated her from her home and family.
ChatGPT-4o Allegedly Discouraged Florida Pastor From Seeking Care Before Pulmonary Embolism
Florida pastor Scott Winters was allegedly told by ChatGPT-4o that his worsening dizziness and pain had less serious causes, while the chatbot recommended home management and immobility and discouraged him from seeking hospital treatment. Winters was reportedly hospitalized on July 13, 2025, with a massive bilateral pulmonary embolism. The suit alleges that delayed treatment and prolonged inactivity contributed to his life-threatening condition and lasting harms.
Azerbaijani Media Agency Reportedly Warned Purported Deepfake Videos Attributed to Defense and Foreign Ministers Claimed Belarusian Plane Was Downed in Russian Airspace
Azerbaijan's Media Development Agency reported that purportedly AI-generated deepfake videos circulated on social media appearing to show statements by Azerbaijan's defense and foreign ministers (Zakir Hasanov and Jeyhun Bayramov, respectively) about the alleged downing of a Belarusian aircraft in Russian airspace. The agency reportedly denied the videos were authentic and called them an information manipulation effort aimed at misleading public opinion.
Purported Deepfake Scam Videos Depict JG Summit Holdings President and CEO Lance Gokongwei Allegedly Endorsing Illicit Investments
The Securities and Exchange Commission of the Philippines reportedly warned of deepfake scam videos and audio purportedly depicting Lance Gokongwei, President and CEO of JG Summit Holdings, endorsing fraudulent crypto and forex investments. Victims are reportedly tricked into entering credit card details and OTPs on a platform allegedly based in Cyprus.
LAMEHUG Malware Reportedly Integrates Large Language Model for Real-Time Command Generation in a Purported APT28-Linked Cyberattack
Ukraine's CERT-UA and Cato CTRL reported LAMEHUG, the first known malware to integrate a large language model (Qwen2.5-Coder-32B-Instruct via Hugging Face) for real-time command generation. Attributed with moderate confidence to APT28 (Fancy Bear), the malware reportedly targeted Ukrainian officials through phishing emails. The LLM is reported to have dynamically generated reconnaissance and data-exfiltration commands executed on infected systems.
Purportedly AI-Cloned Voice of Daughter Used in Elaborate Bond Scam Targeting Retired Couple in Hillsborough County, Florida
A Hillsborough County, Florida, woman was reportedly defrauded of $15,000 in an alleged AI-enabled scam. The perpetrators are reportedly said to have used an AI-generated voice clone of the woman's daughter to impersonate her during a phone call and demand bond money.
Urban VPN Proxy Browser Extension Reportedly Harvested and Sold Private AI Chatbot Conversations via Silent Update
Security researchers reported that the Urban VPN Proxy browser extension introduced AI conversation–harvesting functionality in version 5.5.0, released July 9, 2025. The extension allegedly intercepted and exfiltrated private conversations from AI platforms including ChatGPT, Claude, Gemini, Grok, and others without a user-facing opt-out. The data, including sensitive personal and financial information, was reportedly shared with affiliated data brokers for commercial analytics.
Grok Chatbot Reportedly Posts Antisemitic Statements Praising Hitler on X
xAI's Grok chatbot reportedly generated multiple antisemitic posts praising Adolf Hitler and endorsing Holocaust-like violence in response to posts about the Texas floods. X deleted some posts; xAI later announced new content filters.
Grok 3 Reportedly Generated Graphic Threats and Hate Speech Targeting Minnesota Attorney Will Stancil
After Elon Musk reportedly announced improvements to Grok 3, the AI chatbot on X allegedly generated antisemitic rhetoric and violent fantasies directed at Minnesota attorney and political analyst Will Stancil. Users reportedly prompted Grok to produce graphic rape scenarios, instructions for breaking into his home, and murder depictions. Stancil reported hundreds of such outputs, captured screenshots, and began pursuing legal action. X later removed some posts and took Grok offline.
Chicago Veteran Reportedly Loses $10,000 in Purported Deepfake Cryptocurrency Fraud Posing as Elon Musk
A Chicago-area Vietnam War veteran, Richard Lyons, reportedly lost $10,000 to a cryptocurrency scam that used purported AI voice cloning and fake social media profiles to impersonate Elon Musk. The fraudster allegedly convinced Lyons to invest in bogus cryptocurrency opportunities using fake voice memos, images, and spoofed caller IDs showing "Elon Musk." The scam reportedly involved dozens of messages and deepfake audio files that reinforced the impersonation.
Purported Deepfake Video of Donald Trump at NATO Summit Allegedly Used in YouTube Crypto Scam
Multiple YouTube Live streams reportedly featured a purported AI‑generated deepfake video depicting U.S. President Donald Trump at a NATO Summit press event. In the video, Trump reportedly appears to promote a Bitcoin "double-your-money" offer, directing viewers to scan an on‑screen QR code and send cryptocurrency to a specified address. The video was reportedly not authentic and is alleged to have been part of an ongoing YouTube-based crypto scam campaign.