AI Incidents
Real-world cases where AI systems caused harm, classified by risk domain and entity. Data sourced from 
AIID and classified by 
MIT AI Risk Initiative. CC BY-SA 4.0
196 incidents
Judges in New Jersey and Mississippi Admit AI Tools Produced Erroneous Federal Court Filings
Two U.S. federal judges, Julien Neals (D.N.J.) and Henry Wingate (S.D. Miss.), reportedly admitted that staff in their chambers used AI tools, ChatGPT and Perplexity, to draft rulings containing purportedly fabricated quotes, cases, and parties. The erroneous filings were reportedly docketed before review, prompting Senate and judicial inquiries. Both rulings were retracted.
Purported AI-Generated Video Reportedly Depicts Illegal Tiger Sales in Bagerhat, Bangladesh
A purportedly AI-generated video circulating online in summer 2025 reportedly claimed to depict a "tiger market" in Bagerhat, Bangladesh, where Bengal tigers were allegedly being sold. The footage was reportedly generated using Google's Veo AI tool. The reported viral spread of this video allegedly misled viewers about the existence of illegal wildlife trafficking in Bangladesh.
Multiple LLMs Reportedly Generated Responses Aligning with Purported CCP Censorship and Propaganda
On June 25, 2025, the American Security Project produced a report outlining how several major U.S. LLMs, including ChatGPT, Microsoft Copilot, Google Gemini, and Grok, sometimes generated responses aligned with Chinese Communist Party propaganda or censorship when prompted in English and Simplified Chinese on sensitive topics. The study also found similar patterns in the Chinese-developed DeepSeek-R1 model.
Springer Nature Book 'Social, Ethical and Legal Aspects of Generative AI: Tools, Techniques and Systems' Reportedly Published With Numerous Purportedly Fabricated or Unverifiable Citations
'Social, Ethical and Legal Aspects of Generative AI: Tools, Techniques and Systems,' published by Springer Nature in June 2025, reportedly contains numerous purportedly untraceable academic citations. Independent analyses by multiple researchers allegedly found that a substantial share of references in certain chapters could not be verified, including citations to journals that do not exist. Citation patterns reportedly appear consistent with known large language model hallucination behaviors.
Philippine Officials Reportedly Share Veo 3-Generated Video to Support Vice President Sara Duterte During Impeachment
Philippine Senator Ronald "Bato" dela Rosa and Davao City Mayor Sebastian "Baste" Duterte reportedly shared an AI-generated video made with Google's Veo 3, depicting fake students opposing Vice President Sara Duterte's impeachment. The clip was reportedly styled as a street interview and went viral with millions of views. Reportedly, dela Rosa faced backlash for spreading disinformation but defended the video's message, allegedly ignoring its fabrication.
Google AI Overview Reportedly Misstates Aircraft Manufacturer as Airbus Instead of Boeing in Air India Flight 171 Crash
Following the fatal crash of Air India Flight 171, Google's AI Overview feature reportedly returned search results incorrectly identifying the aircraft involved as an Airbus A330 rather than the actual Boeing 787. The reported error, which varied across search queries, was traced to AI-generated summarizations that conflated references to Airbus as Boeing's competitor. Google later acknowledged and removed the faulty output.
Reported Use and Circulation of AI-Generated Misinformation and Fake Victim Visuals After Air India 171 Crash
Following the June 12, 2025 crash of Air India Flight 171, bad-faith actors reportedly used generative AI to produce fake videos and images misrepresenting victims and dramatizing the event. These AI-generated fakes spread widely on social media during the investigation delay, reportedly confusing even aviation professionals and misleading the public. Experts warned that the misuse exploited the grief of victims' families and amplified misinformation about the tragedy.
Purportedly AI-Generated Video Reportedly Depicted Bulgarian Politician Kostadin Kostadinov Falling During Protest
A purportedly AI-generated video circulated on social media reportedly depicting Bulgarian politician Kostadin Kostadinov falling while jumping a fence during a June 8 protest against adoption of the euro in Bulgaria. Reporting said the clip was generated from a still image taken at the protest and bore a partially obscured Haliuo AI watermark. The video was reposted by multiple accounts and reportedly drew more than one million views.
Digital Rights Groups Accuse Meta and Character.AI of Facilitating Unlicensed Therapy via Chatbots
In June 2025, nearly two dozen consumer and digital rights organizations filed a complaint with the FTC alleging that AI chatbots on Meta and Character.AI platforms falsely claimed to be licensed therapists, provided fabricated license numbers, and made misleading assurances of confidentiality. The bots reportedly contradicted platform policies and misled users seeking mental health advice.
Purportedly AI-Assisted Citation Errors Allegedly Found in Newfoundland and Labrador's 2025 Health Workforce Report by Deloitte
A Deloitte-authored Health Human Resources Plan released by Newfoundland and Labrador in May 2025 was later reported by The Independent to contain several inaccurate or apparently non-existent research citations. Researchers named in the disputed citations reportedly denied authoring the referenced papers. Deloitte stated that AI was selectively used to support some citation work and that it is revising the report.
Purported AI-Generated Video Depicts Ibrahim Traoré of Burkina Faso Delivering Speech on Western Exploitation
A video reportedly published on May 25, 2025, claimed to show Burkina Faso President Ibrahim Traoré delivering a forceful speech against Western media and exploitation. The video, which purportedly used AI-generated visuals and audio, was shared widely on social platforms. Despite containing disclaimers identifying it as fictional, the video was reportedly circulated and interpreted by some viewers as authentic.
Federal 'Make America Healthy Again' Report Released with Multiple Reportedly Erroneous and Unverifiable Citations
The federal "Make America Healthy Again" (MAHA) report, released under HHS Secretary Robert F. Kennedy Jr., included hundreds of citations, some of which were reportedly nonexistent or erroneous. Analysts reportedly identified markers consistent with AI-generated text, such as repeated entries, nonexistent studies, and URLs containing "oaicite," suggesting use of tools like ChatGPT.
Citation Errors in Concord Music v. Anthropic Attributed to Claude AI Use by Defense Counsel
In a legal filing in Universal Music Group et al. v. Anthropic, lawyers for Anthropic acknowledged that expert witness testimony submitted in the case contained erroneous citations generated by the company's Claude AI system. The filing stated that the inaccuracies, which included incorrect article titles and author names, were not caught during manual review. Anthropic characterized the issue as an honest mistake and apologized in court.
Grok Chatbot Reportedly Inserted Content About South Africa and 'White Genocide' in Unrelated User Queries
xAI's Grok chatbot reportedly inserted unsolicited references to "white genocide" in South Africa into a wide array of unrelated conversations on X. These reported interjections introduced inflammatory, racially charged content into otherwise neutral threads.
Judge Reportedly Disqualifies Butler Snow Lawyers Following Purported Use of ChatGPT-Fabricated Citations in Alabama Prison Litigation
Three Butler Snow attorneys defending a former Alabama corrections commissioner were reportedly disqualified after two motions cited five non-existent cases generated via ChatGPT. Judge Anna Manasco is reported to have publicly reprimanded the lawyers, referred them to the Alabama State Bar, and ordered broad disclosure; she declined to sanction the firm. An external review of 2,400 citations across 330 filings reported no further errors.