AI Incidents
Real-world cases where AI systems caused harm, classified by risk domain and entity. Data sourced from 
AIID and classified by 
MIT AI Risk Initiative. CC BY-SA 4.0
1,751 incidents
Hachette Reportedly Canceled Publication of Mia Ballard's Shy Girl After Generative AI Authorship Allegations
Hachette Book Group reportedly canceled U.S. publication of Mia Ballard's horror novel Shy Girl and said its Wildfire imprint would not continue publishing the U.K. edition after investigating allegations that parts of the book were generated with AI. Ballard reportedly said she did not personally use AI and suggested an editor of an earlier self-published version may have done so.
Meta Internal AI Agent Reportedly Gave Advice That Allegedly Exposed Sensitive Data to Unauthorized Employees
Reporting alleged that a Meta internal AI agent, purportedly similar to OpenClaw, posted inaccurate technical advice to an internal forum without approval. An employee reportedly followed the advice, allegedly causing an SEV1 incident in which sensitive company and user data became accessible to unauthorized employees for nearly two hours.
Gemini and Grok Reportedly Misidentified Authentic Minab School-Strike Graveyard Photo as Unrelated Disaster Imagery
Gemini and Grok reportedly gave false provenance claims about an authentic photo of graves prepared for victims of the Minab school strike, identifying it as disaster imagery from Turkey or Indonesia. Researchers verified the photo's location through satellite imagery and related visual evidence.
Grok Reportedly Misclassified Netanyahu Proof-of-Life Video as AI-Generated Deepfake Amid Iran War Rumors
During the Iran war, Grok reportedly told users that a café video posted by Israeli Prime Minister Benjamin Netanyahu was AI-generated or a deepfake, after the clip was released to counter rumors that he was dead or injured. Reuters verified the video's location and date and later reported that Netanyahu publicly dispelled the death rumors. Reports said Grok's answers amplified doubts about the clip.
Purported Deepfake of Ashley James Reportedly Used to Promote Weight Loss Pills
An online ad reportedly used a purported AI-generated version of Ashley James, a British broadcaster and former reality television personality, to market weight loss pills through a false celebrity endorsement. James said the video copied her face and voice without consent and described the ad as both a violation of her identity and a misleading sales tactic directed at the public.
Sixth Circuit Sanctioned Lawyers in Whiting v. City of Athens over Alleged Fake Appellate Citations in Briefs Reportedly Bearing Hallmarks of Hallucinations
The U.S. Court of Appeals for the Sixth Circuit sanctioned attorneys Van Irion and Russ Egli after reportedly finding more than two dozen fake citations and alleged factual misrepresentations in appellate briefs in Whiting v. City of Athens. The court asked whether generative AI had been used, but the attorneys reportedly did not answer that question. Public reporting described the filings as bearing hallmarks of AI hallucinations.
Grammarly's AI Expert Review Allegedly Used Journalists' and Authors' Names Without Consent
Grammarly's Expert Review feature allegedly used a large language model to generate editing suggestions presented under the names of journalists, authors, and academics without their consent. A federal class action filed by Julia Angwin claimed the feature misappropriated identities for commercial gain and attributed advice the named individuals never gave.
Purported AI-Generated Nude Images Reportedly Used to Extort Wichita Man in Kansas
A Wichita, Kansas man reported that scammers sent him purported AI-generated nude images depicting his face on another body in his home and threatened to send them to his Facebook contacts unless he paid money. Police said a report was filed.
Grok Allegedly Generated Publicly Visible Sexist Abuse Targeting Swiss Finance Minister Karin Keller-Sutter After X User Prompt
An X user reportedly prompted xAI's Grok to generate a vulgar "roast" targeting Swiss Finance Minister Karin Keller-Sutter. Grok allegedly produced publicly visible sexist and insulting output about Keller-Sutter that was reportedly shareable on X before being deleted. Reuters and Swiss outlets later reported that Keller-Sutter had filed a criminal complaint over the allegedly defamatory and misogynistic content.
Purported Deepfake Scam Ad Reportedly Used Lara Lewington and Martin Lewis to Promote Quantum AI Scheme
Scammers reportedly used a purported deepfake video of Lara Lewington being assaulted to promote a fake "Martin Lewis Quantum AI" investment opportunity. According to reporting, Martin Lewis claimed the video prompted worried messages from friends and was designed to trick viewers into engaging with a fraudulent financial scheme.
Purported AI-Generated Inland Revenue Scam Ads Reportedly Impersonated New Zealand Commissioner Peter Mersi in Alleged Fake Crypto Tax Webinar
New Zealand Inland Revenue warned that scammers used a purported AI-generated likeness of Commissioner Peter Mersi with alleged false Inland Revenue branding, as well as misleading social media ads, to promote an allegedly fake webinar on crypto tax changes. The campaign allegedly sought to trick people into disclosing personal information.
Purported Gemini-Generated AI Images Reportedly Claimed U.S. Delta Force Soldiers Were Captured by the IRGC
Images purportedly generated by Gemini were reportedly circulated on X and Facebook in multiple languages claiming U.S. soldiers had been captured by the Iranian Revolutionary Guard Corps during the war in Iran. AFP said the images contained Gemini markers and other visual inconsistencies. Their circulation allegedly contributed to wartime misinformation and risked distorting public understanding of the conflict, including reported amplification by Jill Stein.
Nippon Life Alleged ChatGPT Practiced Law Without a License in Illinois Disability Case
Nippon Life sued OpenAI in Chicago, alleging ChatGPT acted as an unlicensed lawyer by helping a former disability claimant reopen a settled case and generate numerous meritless filings. The insurer claimed the conduct caused legal expense and abuse-of-process harms. OpenAI said the complaint lacks merit.
Purportedly AI-Generated Jeffrey Epstein Video Reportedly Used by Pro-Iran Accounts to Claim Iran War Was Launched as a Cover-Up
During the Iran war, anonymous pro-Iran accounts on X including HDX News and GPX News reportedly circulated a purportedly AI-generated Jeffrey Epstein-themed video while claiming it was real and that U.S.-Israeli strikes on Iran were launched to distract from Epstein-related material. The Washington Post reported the HDX News post received more than 6.8 million views and GPX News's version received more than 4.7 million before both accounts were suspended by X.
DOJ Attorney Reportedly Used AI to File Brief With Purportedly Fabricated Quotes and Misstated Case Holdings
In Fivehouse v. U.S. Department of Defense, Assistant U.S. Attorney Rudy Renfer filed a response brief that the court reportedly said contained fabricated quotations and misstatements of case holdings. Renfer reportedly admitted he had used AI to help draft the inaccurate filing after losing an earlier draft. The court reportedly also identified similar fabricated quotations in other filings signed by Renfer.