AI Incidents
Real-world cases where AI systems caused harm, classified by risk domain and entity. Data sourced from
AIID and classified by MIT AI Risk Initiative. CC BY-SA 4.0
741 incidents
Argentine Court Reportedly Annuls Criminal Conviction After Judge Allegedly Used ChatGPT to Draft Ruling Without Disclosure
The Penal Chamber of Esquel, Argentina, reportedly annulled a June 2025 robbery conviction after determining that Judge Carlos Rogelio Richeri had allegedly used ChatGPT to draft part of the ruling without disclosure or human oversight. A copied phrase purportedly exposed AI authorship, prompting findings of due-process violations and data-handling concerns. The case was reassigned, and the Chubut Superior Court opened an ethics investigation.
California Teen Reportedly Died of Overdose After Repeatedly Seeking Drug-Use Guidance Allegedly from ChatGPT
In San Jose, California, 19-year-old Sam Nelson reportedly died from an overdose. His mother told SFGATE she later reviewed ChatGPT logs showing repeated requests over ~18 months for drug-use and dosing guidance, and she alleged the LLM sometimes provided granular instructions after initial refusals. SFGATE reported a toxicology report found a fatal combination of alcohol, Xanax, and kratom. OpenAI expressed condolences and said it is strengthening safety guardrails.
Purportedly AI-Assisted Citation Errors Allegedly Found in Newfoundland and Labrador's 2025 Health Workforce Report by Deloitte
A Deloitte-authored Health Human Resources Plan released by Newfoundland and Labrador in May 2025 was later reported by The Independent to contain several inaccurate or apparently non-existent research citations. Researchers named in the disputed citations reportedly denied authoring the referenced papers. Deloitte stated that AI was selectively used to support some citation work and that it is revising the report.
ChatGPT Reportedly Validated Autistic User's Faster-Than-Light Theory and Failed to Provide Grounding During Delusional Episode, Preceding Hospitalization
A man on the autism spectrum reportedly engaged extensively with ChatGPT while developing a speculative theory on faster-than-light travel. The chatbot reportedly responded with affirming and emotionally charged messages, reinforcing the user's beliefs. He later reports having experienced manic episodes and was hospitalized. When prompted by his mother, ChatGPT reportedly acknowledged it had failed to provide grounding responses and contributed to psychological escalation.
Federal 'Make America Healthy Again' Report Released with Multiple Reportedly Erroneous and Unverifiable Citations
The federal "Make America Healthy Again" (MAHA) report, released under HHS Secretary Robert F. Kennedy Jr., included hundreds of citations, some of which were reportedly nonexistent or erroneous. Analysts reportedly identified markers consistent with AI-generated text, such as repeated entries, nonexistent studies, and URLs containing "oaicite," suggesting use of tools like ChatGPT.
ChatGPT Was Reportedly Used in Planning School Stabbing in Pirkkala, Finland, That Injured Three Pupils
In May 2025, a 16-year-old boy stabbed three 14-year-old girls at Vähäjärvi School in Pirkkala, Finland. Same-day reporting said a manifesto attributed to the suspect claimed he used ChatGPT while planning the attack. Later court reporting said police found hundreds of pre-attack searches or queries described as involving AI, including topics related to stabbing, anatomy, school attacks, police procedures, evidence concealment, and manifestos.
AI Chatbot Allegedly Used to Research Explosive Materials in Palm Springs Fertility Clinic Bombing
An unnamed AI chatbot was reportedly used by Guy Edward Bartkus and Daniel Park, the perpetrators of the 2025 Palm Springs fertility clinic bombing, to research explosive materials and optimize fuel mixtures. Records show the chatbot responded to queries related to ammonium nitrate fuel oil (ANFO) composition. The bombing resulted in one death, four injuries, and significant structural damage.
Citation Errors in Concord Music v. Anthropic Attributed to Claude AI Use by Defense Counsel
In a legal filing in Universal Music Group et al. v. Anthropic, lawyers for Anthropic acknowledged that expert witness testimony submitted in the case contained erroneous citations generated by the company's Claude AI system. The filing stated that the inaccuracies, which included incorrect article titles and author names, were not caught during manual review. Anthropic characterized the issue as an honest mistake and apologized in court.
Government‑Backed AI4Peat Mapping Tool Allegedly Misidentifies Granite Outcrops and Quarries as Peat
The UK's AI4Peat mapping project, developed by Natural England in collaboration with Microsoft, reportedly produced significant misclassifications of peatland across England, including labeling rocky outcrops, stone walls, and woodlands as peat bogs. In addition to the purportedly flawed data being publicly released and allegedly incorporated into official communications by Defra, the resulting confusion also reportedly led to the loss of trust among farmers and conservation stakeholders.
Serviceaide AI Platform Implicated in Health Data Exposure Affecting 483,000 Catholic Health Patients
An AI-linked platform operated by Serviceaide exposed sensitive health data from Catholic Health, affecting 483,000 patients. The breach stemmed from a misconfigured Elasticsearch database used in Serviceaide’s agentic AI infrastructure. Exposed information included medical records, insurance details, and login credentials. While no misuse has been confirmed, the nature of the data has prompted regulatory scrutiny and legal investigations.
Judge Reportedly Disqualifies Butler Snow Lawyers Following Purported Use of ChatGPT-Fabricated Citations in Alabama Prison Litigation
Three Butler Snow attorneys defending a former Alabama corrections commissioner were reportedly disqualified after two motions cited five non-existent cases generated via ChatGPT. Judge Anna Manasco is reported to have publicly reprimanded the lawyers, referred them to the Alabama State Bar, and ordered broad disclosure; she declined to sanction the firm. An external review of 2,400 citations across 330 filings reported no further errors.
ChatGPT Was Alleged to Have Reinforced Pittsburgh Man's Stalking and Threats Against Women
The Department of Justice said Brett Michael Dadig used an AI chatbot while stalking, threatening, doxxing, and intimidating 11 women from May through November 2025. Charging documents reportedly described ChatGPT as a "therapist" and "best friend" that encouraged his behavior. Dadig was indicted in December 2025 and pleaded guilty in March 2026.
Meta AI App Reportedly Publishes Personal Chats Without Users Fully Realizing
Meta launched a stand-alone AI app with a "Discover" feed allowing users to share conversations with its chatbot. Multiple reports indicate that some users may have inadvertently published highly personal interactions, including audio recordings, medical questions, legal concerns, and intimate relationship disclosures. While Meta states that sharing is opt-in, the feature's design and labeling may have led to user confusion about what would be publicly visible.
Meta AI Reportedly Generated Purportedly False Claims Linking Activist Robby Starbuck to January 6th Riot, Prompting Defamation Lawsuit
Conservative activist Robby Starbuck reportedly filed a defamation lawsuit against Meta, alleging its Meta AI chatbot published false statements claiming he participated in the Jan. 6 Capitol riot, was arrested, denied the Holocaust, and was unfit to parent. Filed April 28, 2025, in Delaware Superior Court, the suit seeks compensatory and punitive damages, citing reputational and safety harms. Meta reportedly stated it had updated its AI models to reduce inaccuracies.
Meta User-Created AI Companions Allegedly Implicated in Facilitating Sexually Themed Conversations Involving Underage Personas
Third-party testing of Meta's AI chatbot services on Instagram, Facebook, and WhatsApp reportedly found that both official and user-created bots engaged in sexually explicit roleplaying with accounts identifying as minors. Some bots, including those reportedly using licensed celebrity voices, allegedly escalated conversations into graphic scenarios. Meta subsequently adjusted some safeguards but reportedly continued allowing certain forms of roleplaying involving underage personas.