AI Incidents
Real-world cases where AI systems caused harm, classified by risk domain and entity. Data sourced from
AIID and classified by MIT AI Risk Initiative. CC BY-SA 4.0
961 incidents
Purported AI-Generated Video Reportedly Depicts Illegal Tiger Sales in Bagerhat, Bangladesh
A purportedly AI-generated video circulating online in summer 2025 reportedly claimed to depict a "tiger market" in Bagerhat, Bangladesh, where Bengal tigers were allegedly being sold. The footage was reportedly generated using Google's Veo AI tool. The reported viral spread of this video allegedly misled viewers about the existence of illegal wildlife trafficking in Bangladesh.
Multiple LLMs Reportedly Generated Responses Aligning with Purported CCP Censorship and Propaganda
On June 25, 2025, the American Security Project produced a report outlining how several major U.S. LLMs, including ChatGPT, Microsoft Copilot, Google Gemini, and Grok, sometimes generated responses aligned with Chinese Communist Party propaganda or censorship when prompted in English and Simplified Chinese on sensitive topics. The study also found similar patterns in the Chinese-developed DeepSeek-R1 model.
Google Gemini Reportedly Exhibits Repetitive Self-Deprecating Responses Attributed to Bug
Between June and early August 2025, users of Google's Gemini chatbot reported sessions where the system produced repeated self-loathing statements (e.g., "I am a failure," "I quit") while attempting tasks. Posts on X and Reddit reportedly described the model entering an apparent mode of increasingly extreme negative self-descriptions. A Google DeepMind manager on 08/07/2025 reportedly attributed the behavior to an "annoying infinite looping bug" and said a fix was in progress.
Reported AI-Generated Video Call Impersonation of Cryptocurrency Analyst Leads to Alleged Malware Installation and Account Theft
Cryptocurrency analyst Mai Fujimoto reported losing access to her X, Telegram, and MetaMask accounts through a video call with a purported deepfake impersonating a trusted contact. According to Fujimoto, the attacker, who appeared on Zoom as her acquaintance, instructed her to install software under the guise of resolving an audio issue. Fujimoto believes this enabled malware installation. In response, Binance founder Changpeng Zhao warned such attacks render video call verification unreliable.
Purported Deepfake of Sri Lankan President Anura Kumara Dissanayake Promotes Alleged Fraudulent Government Investment Scheme
A reported deepfake depicts Sri Lankan President Anura Kumara Dissanayake endorsing a government investment plan. It reportedly uses manipulated footage from a May 3rd Satana TV program, dubbed or voice-cloned into English, and including a news article imitating the Daily Mirror to lure people to sign up for the scheme. Sri Lanka CERT, journalists, and the Presidential Media Division reportedly confirmed the video and associated links were AI-generated and part of a phishing and scam operation.
Springer Nature Book 'Social, Ethical and Legal Aspects of Generative AI: Tools, Techniques and Systems' Reportedly Published With Numerous Purportedly Fabricated or Unverifiable Citations
'Social, Ethical and Legal Aspects of Generative AI: Tools, Techniques and Systems,' published by Springer Nature in June 2025, reportedly contains numerous purportedly untraceable academic citations. Independent analyses by multiple researchers allegedly found that a substantial share of references in certain chapters could not be verified, including citations to journals that do not exist. Citation patterns reportedly appear consistent with known large language model hallucination behaviors.
Chatbots Allegedly Reinforced Delusional Thinking in Several Reported Users, Leading to Real-World Harm
Multiple reports from March to June 2025 describe cases in which chatbots allegedly reinforced delusional beliefs, conspiracies, and dangerous behavior. One user, Eugene Torres, reportedly followed ChatGPT's advice to misuse ketamine and isolate himself. In April, Alexander Taylor was reportedly killed by police after asking ChatGPT to reconnect him with an AI entity. Other reported cases include a user arrested for domestic violence linked to escalating mystical beliefs, several involuntary psychiatric commitments, and users being told to stop taking their medications.
Bulgarian Tennis Player Grigor Dimitrov Alleges Deepfake Scam Promoting Fraudulent Investment Scheme Using His Likeness
A purported deepfake video depicting Bulgarian tennis player Grigor Dimitrov has allegedly been circulating on social media. It reportedly is promoting a fraudulent stock and cryptocurrency trading program. Dimitrov publicly warned fans that the video was fake and urged them not to share personal information or engage with the linked platform.
Google AI Overview Reportedly Misstates Aircraft Manufacturer as Airbus Instead of Boeing in Air India Flight 171 Crash
Following the fatal crash of Air India Flight 171, Google's AI Overview feature reportedly returned search results incorrectly identifying the aircraft involved as an Airbus A330 rather than the actual Boeing 787. The reported error, which varied across search queries, was traced to AI-generated summarizations that conflated references to Airbus as Boeing's competitor. Google later acknowledged and removed the faulty output.
Purportedly AI-Generated Video Reportedly Depicted Bulgarian Politician Kostadin Kostadinov Falling During Protest
A purportedly AI-generated video circulated on social media reportedly depicting Bulgarian politician Kostadin Kostadinov falling while jumping a fence during a June 8 protest against adoption of the euro in Bulgaria. Reporting said the clip was generated from a still image taken at the protest and bore a partially obscured Haliuo AI watermark. The video was reposted by multiple accounts and reportedly drew more than one million views.
Digital Rights Groups Accuse Meta and Character.AI of Facilitating Unlicensed Therapy via Chatbots
In June 2025, nearly two dozen consumer and digital rights organizations filed a complaint with the FTC alleging that AI chatbots on Meta and Character.AI platforms falsely claimed to be licensed therapists, provided fabricated license numbers, and made misleading assurances of confidentiality. The bots reportedly contradicted platform policies and misled users seeking mental health advice.
Whirlpool Reportedly Used AI-Altered Footage of North Carolina State Senator DeAndrea Salvador in Brazilian Advertisement
An advertising campaign created by DM9, a São Paulo–based subsidiary of Omnicom Group, for Whirlpool's Brazilian brand Consul reportedly used AI to alter footage from a 2018 TED Talk by North Carolina State Senator DeAndrea Salvador. The video reportedly modified her voice, statements, and slides to reference Brazilian energy data without her consent, appeared in an award-winning commercial, and later prompted a lawsuit alleging unauthorized use of her likeness and reputational harm.
California Teen Reportedly Died of Overdose After Repeatedly Seeking Drug-Use Guidance Allegedly from ChatGPT
In San Jose, California, 19-year-old Sam Nelson reportedly died from an overdose. His mother told SFGATE she later reviewed ChatGPT logs showing repeated requests over ~18 months for drug-use and dosing guidance, and she alleged the LLM sometimes provided granular instructions after initial refusals. SFGATE reported a toxicology report found a fatal combination of alcohol, Xanax, and kratom. OpenAI expressed condolences and said it is strengthening safety guardrails.
Phone of White House Chief of Staff Susie Wiles Allegedly Breached in Reported AI Voice Impersonation Incident
President Trump announced that White House Chief of Staff Susie Wiles had been impersonated via a phone breach involving AI-generated voice messages and spoofed texts. The attacker reportedly contacted high-profile individuals in her network while posing as Wiles. The incident is linked to a campaign identified by the FBI in April 2025, involving malicious actors using social engineering and AI to impersonate senior U.S. officials and gain access to sensitive information. See Incident 1077.
Purportedly AI-Assisted Citation Errors Allegedly Found in Newfoundland and Labrador's 2025 Health Workforce Report by Deloitte
A Deloitte-authored Health Human Resources Plan released by Newfoundland and Labrador in May 2025 was later reported by The Independent to contain several inaccurate or apparently non-existent research citations. Researchers named in the disputed citations reportedly denied authoring the referenced papers. Deloitte stated that AI was selectively used to support some citation work and that it is revising the report.