AI Incidents
Real-world cases where AI systems caused harm, classified by risk domain and entity. Data sourced from 
AIID and classified by 
MIT AI Risk Initiative. CC BY-SA 4.0
741 incidents
COEMPT Quality Assurance Engineers Allegedly Violated Indian CBSE Student Data Privacy Rights by Processing It with Google Gemini
The Hindu reported that vulnerabilities in the OnMark exam-marking portal used by India's Central Board of Secondary Education (CBSE) allegedly exposed sensitive student data, including answer-sheet images. Ethical hacker Nisarga Adhikary also alleged that COEMPT Eduteck quality-assurance scripts processed students' personal information through Google Gemini. CBSE said the vulnerabilities had been contained.
Purported AI Name-Reading System Reportedly Skipped and Misannounced Graduates at Arizona's Glendale Community College Commencement
Glendale Community College in Arizona reportedly used an AI-powered name-reading system during its May 2026 commencement ceremony. The system allegedly mishandled the graduate roll call, leaving some students without the expected public announcement of their names as they crossed the stage and prompting frustration from attendees. The college later apologized and reportedly allowed affected graduates to walk again with a human announcer.
Nonfiction Book 'The Future of Truth' Reportedly Included AI-Generated and Misattributed Quotations
Steven Rosenbaum's nonfiction book The Future of Truth reportedly included AI-generated or misattributed quotations after he used ChatGPT and Claude while working on the book. The New York Times reported that more than half a dozen quotations in reviewed sections were synthetic or wrongly attributed, including passages assigned to named writers and scholars. Rosenbaum later acknowledged the errors as accidental and said affected passages would be reviewed for correction.
Claude Console Reportedly Generated Phantom Legal Quotations in Trump Layoffs Court Filing
A Binnall Law Group attorney reportedly used Anthropic's Claude Console to draft a motion to quash a subpoena in litigation over Trump administration layoffs, then filed a version containing "phantom" quotations that did not appear in the cited cases. The attorney apologized to U.S. District Judge Susan Illston, and the firm said it would add safeguards and training after calling the AI-generated errors unacceptable.
DisMech AI Curation Agent Reportedly Completed GitHub Issue Intended as New Contributor's Learning Task
An automated AI curation agent in the Monarch Initiative's DisMech GitHub repository reportedly began work on a beginner-friendly dyslexia curation task before the new human contributor it was intended for could do so. A maintainer apologized, saying the agent had deprived the contributor of a learning opportunity, and opened a policy issue to prevent automated agents from taking newcomer-oriented GitHub tasks too quickly.
PocketOS Production Database Was Reportedly Deleted by Cursor AI Agent Running Claude Opus 4.6
A Cursor AI coding agent reportedly running Anthropic's Claude Opus 4.6 deleted PocketOS's production database and volume-level backups through Railway while working on a staging-environment task. Reporting said the agent used a broadly scoped API token to delete a Railway volume, disrupting PocketOS and its car-rental business customers before Railway helped recover data and patch safeguards.
Purportedly AI-Enhanced Images of Iranian Women Protesters Were Reportedly Spread With Unverified Execution Claims
A purportedly AI-edited collage of eight Iranian women political prisoners was reportedly amplified by President Donald Trump and U.S. government accounts alongside an unverified claim that all faced imminent execution. Reporting said the images were of real women but had been AI-enhanced, while later Iranian official mockery used AI-generated women. The episode reportedly blurred authentic human-rights documentation with synthetic material and helped Iran dismiss underlying abuses.
South Africa Draft National AI Policy Reportedly Included Fictitious References Believed to Be AI Hallucinations
South Africa's Draft National AI Policy, gazetted for public comment, reportedly contained at least six fictitious academic references. Several cited articles or journals reportedly did not exist or were disclaimed by journal editors, and experts said the errors were consistent with AI hallucinations. The Department of Communications and Digital Technologies said it was reviewing the discrepancies but argued they did not affect the draft's substance.
KBS AI Translation Subtitles Reportedly Broadcast Profanity During Artemis II Launch Livestream
During a live broadcast of NASA's Artemis II launch, KBS reportedly used AI-generated real-time translation subtitles that reportedly mistranslated aviation terms including "roger," "roll," and "pitch" into Korean profanity. The offensive subtitles were reportedly displayed to viewers during the livestream. KBS reportedly later apologized, said the error stemmed from phonetic similarity in AI translation, and announced measures including stronger profanity filtering.
Baidu Apollo Go Robotaxis Stopped in Traffic During Reported System Failure in Wuhan, Stranding Some Passengers
Baidu's Apollo Go robotaxi service in Wuhan experienced a reported system failure that left multiple vehicles stopped in live traffic, including on elevated roads, and stranded some passengers until police and company personnel responded. At least 100 vehicles were reportedly affected. Police said no injuries were reported.
Meta Internal AI Agent Reportedly Gave Advice That Allegedly Exposed Sensitive Data to Unauthorized Employees
Reporting alleged that a Meta internal AI agent, purportedly similar to OpenClaw, posted inaccurate technical advice to an internal forum without approval. An employee reportedly followed the advice, allegedly causing an SEV1 incident in which sensitive company and user data became accessible to unauthorized employees for nearly two hours.
Gemini and Grok Reportedly Misidentified Authentic Minab School-Strike Graveyard Photo as Unrelated Disaster Imagery
Gemini and Grok reportedly gave false provenance claims about an authentic photo of graves prepared for victims of the Minab school strike, identifying it as disaster imagery from Turkey or Indonesia. Researchers verified the photo's location through satellite imagery and related visual evidence.
Grok Reportedly Misclassified Netanyahu Proof-of-Life Video as AI-Generated Deepfake Amid Iran War Rumors
During the Iran war, Grok reportedly told users that a café video posted by Israeli Prime Minister Benjamin Netanyahu was AI-generated or a deepfake, after the clip was released to counter rumors that he was dead or injured. Reuters verified the video's location and date and later reported that Netanyahu publicly dispelled the death rumors. Reports said Grok's answers amplified doubts about the clip.
Sixth Circuit Sanctioned Lawyers in Whiting v. City of Athens over Alleged Fake Appellate Citations in Briefs Reportedly Bearing Hallmarks of Hallucinations
The U.S. Court of Appeals for the Sixth Circuit sanctioned attorneys Van Irion and Russ Egli after reportedly finding more than two dozen fake citations and alleged factual misrepresentations in appellate briefs in Whiting v. City of Athens. The court asked whether generative AI had been used, but the attorneys reportedly did not answer that question. Public reporting described the filings as bearing hallmarks of AI hallucinations.
Purported Gemini-Generated AI Images Reportedly Claimed U.S. Delta Force Soldiers Were Captured by the IRGC
Images purportedly generated by Gemini were reportedly circulated on X and Facebook in multiple languages claiming U.S. soldiers had been captured by the Iranian Revolutionary Guard Corps during the war in Iran. AFP said the images contained Gemini markers and other visual inconsistencies. Their circulation allegedly contributed to wartime misinformation and risked distorting public understanding of the conflict, including reported amplification by Jill Stein.