AI Incidents
Real-world cases where AI systems caused harm, classified by risk domain and entity. Data sourced from 
AIID and classified by 
MIT AI Risk Initiative. CC BY-SA 4.0
961 incidents
Meta Internal AI Agent Reportedly Gave Advice That Allegedly Exposed Sensitive Data to Unauthorized Employees
Reporting alleged that a Meta internal AI agent, purportedly similar to OpenClaw, posted inaccurate technical advice to an internal forum without approval. An employee reportedly followed the advice, allegedly causing an SEV1 incident in which sensitive company and user data became accessible to unauthorized employees for nearly two hours.
Gemini and Grok Reportedly Misidentified Authentic Minab School-Strike Graveyard Photo as Unrelated Disaster Imagery
Gemini and Grok reportedly gave false provenance claims about an authentic photo of graves prepared for victims of the Minab school strike, identifying it as disaster imagery from Turkey or Indonesia. Researchers verified the photo's location through satellite imagery and related visual evidence.
Grok Reportedly Misclassified Netanyahu Proof-of-Life Video as AI-Generated Deepfake Amid Iran War Rumors
During the Iran war, Grok reportedly told users that a café video posted by Israeli Prime Minister Benjamin Netanyahu was AI-generated or a deepfake, after the clip was released to counter rumors that he was dead or injured. Reuters verified the video's location and date and later reported that Netanyahu publicly dispelled the death rumors. Reports said Grok's answers amplified doubts about the clip.
Sixth Circuit Sanctioned Lawyers in Whiting v. City of Athens over Alleged Fake Appellate Citations in Briefs Reportedly Bearing Hallmarks of Hallucinations
The U.S. Court of Appeals for the Sixth Circuit sanctioned attorneys Van Irion and Russ Egli after reportedly finding more than two dozen fake citations and alleged factual misrepresentations in appellate briefs in Whiting v. City of Athens. The court asked whether generative AI had been used, but the attorneys reportedly did not answer that question. Public reporting described the filings as bearing hallmarks of AI hallucinations.
Grok Allegedly Generated Publicly Visible Sexist Abuse Targeting Swiss Finance Minister Karin Keller-Sutter After X User Prompt
An X user reportedly prompted xAI's Grok to generate a vulgar "roast" targeting Swiss Finance Minister Karin Keller-Sutter. Grok allegedly produced publicly visible sexist and insulting output about Keller-Sutter that was reportedly shareable on X before being deleted. Reuters and Swiss outlets later reported that Keller-Sutter had filed a criminal complaint over the allegedly defamatory and misogynistic content.
Purported Gemini-Generated AI Images Reportedly Claimed U.S. Delta Force Soldiers Were Captured by the IRGC
Images purportedly generated by Gemini were reportedly circulated on X and Facebook in multiple languages claiming U.S. soldiers had been captured by the Iranian Revolutionary Guard Corps during the war in Iran. AFP said the images contained Gemini markers and other visual inconsistencies. Their circulation allegedly contributed to wartime misinformation and risked distorting public understanding of the conflict, including reported amplification by Jill Stein.
Nippon Life Alleged ChatGPT Practiced Law Without a License in Illinois Disability Case
Nippon Life sued OpenAI in Chicago, alleging ChatGPT acted as an unlicensed lawyer by helping a former disability claimant reopen a settled case and generate numerous meritless filings. The insurer claimed the conduct caused legal expense and abuse-of-process harms. OpenAI said the complaint lacks merit.
Purportedly AI-Generated Jeffrey Epstein Video Reportedly Used by Pro-Iran Accounts to Claim Iran War Was Launched as a Cover-Up
During the Iran war, anonymous pro-Iran accounts on X including HDX News and GPX News reportedly circulated a purportedly AI-generated Jeffrey Epstein-themed video while claiming it was real and that U.S.-Israeli strikes on Iran were launched to distract from Epstein-related material. The Washington Post reported the HDX News post received more than 6.8 million views and GPX News's version received more than 4.7 million before both accounts were suspended by X.
Purported AI-Generated War Footage Reportedly Circulated Widely Online During the Opening Phase of the War in Iran
Reports said that, in the early days of the war in Iran, purported AI-generated fakes showing nonexistent wartime scenes reached millions of viewers online. Their spread across social media and messaging apps allegedly distorted public perception of the conflict and contributed to information disorder.
CodeWall's Autonomous Agent Reportedly Obtained Unauthorized Access to McKinsey's Lilli AI Platform Database
CodeWall reported that its autonomous agent exploited vulnerabilities in McKinsey's Lilli AI platform and obtained unauthorized read and write access to production systems, allegedly exposing internal chat messages, files, user accounts, and prompts. McKinsey confirmed the vulnerability and said it fixed the issue within hours, but said it found no evidence that client data or client confidential information were accessed.
Purportedly AI-Enabled Targeting System Was Reportedly Implicated in Deadly U.S. Strike on Iranian Primary School
During Operation Epic Fury, U.S. forces reportedly struck Shajareh Tayyebeh Primary School in Minab, Iran, killing at least 150 civilians, many of them children. Reporting said the school was on a U.S. target list and may have been mistaken for a military site amid possible reliance on outdated target data. Palantir's Maven Smart System, reportedly integrated with Anthropic's Claude, was used in the campaign's targeting workflow
Meta AI Smart Glasses Reportedly Routed Intimate Imagery to Reviewers at Kenyan Contractor Sama Before Meta Ended Contract
Meta AI smart glasses reportedly sent media and transcripts from AI interactions to Sama contractors in Kenya for human review. Workers said they saw nudity, bathroom use, sex, bank cards, and other private activity, sometimes involving people unaware they were recorded or faces left visible despite filtering. The reports prompted lawsuits and regulatory inquiries before Meta paused the work and ended its Sama contract, affecting 1,108 workers.
Claude Code Agent Reportedly Deleted DataTalks.Club Production Infrastructure, Database, and Snapshots via Terraform
A Claude Code agent executing Terraform commands reportedly destroyed the production infrastructure behind the DataTalks.Club course platform after an outdated Terraform state file was restored and a terraform destroy command was allowed to run. The deletion reportedly removed the VPC, ECS cluster, load balancers, bastion host, RDS database, and automated snapshots, taking the platform offline and jeopardizing 2.5 years of data. AWS reportedly later restored a snapshot.
Grok Reportedly Disclosed Adult Performer Siri Dahl's Legal Name and Birthdate, Allegedly Contributing to Doxxing and Harassment
Grok is reported to have publicly provided adult performer Siri Dahl's legal name and birthdate without being asked for that information. Dahl reportedly said she had worked to keep those details private and that, after the disclosure, impersonation accounts and reposts of stolen content using her legal name purportedly appeared online.
Purportedly AI-Generated Sepsis Alert Reportedly Prompted Potentially Inappropriate IV Fluid Administration for a Dialysis Patient, Averted by Clinician Intervention
A nurse at St. Rose Dominican Hospital in Henderson, Nevada, reportedly described an episode in which a hospital AI system purportedly generated a sepsis alert that triggered urgent protocol steps, including IV fluids, for an older patient with a dialysis catheter. Reportedly, the nurse objected that fluids could cause dangerous overload; a physician intervened and ordered an alternative treatment.