AI Incidents
Real-world cases where AI systems caused harm, classified by risk domain and entity. Data sourced from
AIID and classified by MIT AI Risk Initiative. CC BY-SA 4.0
1,751 incidents
ChatGPT Reportedly Found to Reproduce Protected German Lyrics in Copyright Case
A Munich regional court ruled that ChatGPT reportedly reproduced protected German song lyrics and that OpenAI's models were trained on copyrighted texts, including works by musician Herbert Grönemeyer, without authorization. The court reportedly found both memorization of nine songs and lyric output to infringe exploitation rights. OpenAI disputes the ruling and may appeal. Damages were ordered, with implications for AI training on copyrighted works.
Purported AI-Generated Sexual Deepfakes Allegedly Deployed in Transnational Harassment Campaign Targeting Hong Kong Exiles
Purported deepfake images of exiled Hong Kong pro-democracy activists were reportedly mailed to neighbors and others in the UK and Australia in late 2025. The letters allegedly depicted altered sexual images and false advertisements portraying activists, including Carmen Lau, as sex workers. Police described the materials as malicious communications. The incidents were described by victims and officials as an escalation of transnational harassment and intimidation.
Rep. Mike Collins's Campaign Allegedly Produced Deepfake of Sen. Jon Ossoff Supporting the Government Shutdown
Rep. Mike Collins's congressional campaign allegedly created and posted an AI-generated video that purportedly used Sen. Jon Ossoff's portrait and synthetic voice to falsely depict him supporting the ongoing government shutdown. The video was reportedly shared on the campaign's X account with a limited disclaimer. Georgia Democrats criticized the deepfake as misleading, and the campaign reportedly indicated it would continue using similar AI tactics.
Purportedly AI-Generated Sexual Images of At Least 400 Minors at Zacatecas School Were Reportedly Created and Sold Online
A student at Escuela Secundaria Técnica No. 1 in Zacatecas, Mexico, allegedly used an AI image-generation system to create sexually explicit manipulated images of classmates. According to victims and parents, the student reportedly produced a catalog containing images of more than 400 minors, organized by grade and group, and distributed or sold the material online. Students reported that the perpetrator took photos around the school to use as inputs. The Fiscalía de Zacatecas opened an investigation for crimes against sexual privacy and offered psychological and legal support to victims. The manipulated images are reportedly believed to have circulated beyond the school.
Alleged Harmful Health Outcomes Following Reported Use of Purported ChatGPT-Generated Medical Advice in Hyderabad
Reports from Hyderabad describe two alleged patient harms after individuals acted on purportedly ChatGPT-generated medical advice instead of clinician guidance. A kidney-transplant recipient reportedly discontinued prescribed post-transplant medications based on a chatbot suggestion and experienced graft failure. In a separate case, a man with diabetes allegedly developed severe hyponatremia after following a chatbot-advised zero-salt diet.
ChatGPT Allegedly Provided Bomb-Making Guidance to a Suspect in the Red Fort Bombing in Delhi, India
A suspect in the fatal Red Fort bombing in Delhi, India, allegedly sought and received bomb-making guidance from OpenAI's ChatGPT chatbot. Reporting citing India's National Investigation Agency says Jasir Bilal Wani used AI-generated responses during explosive-device experimentation for an Al-Qaeda-linked cell, including development of rocket-based devices.
Alleged AI-Generated Deepfake of Western Australia Premier Roger Cook Used in YouTube Investment Scam
Western Australia's Consumer Protection commissioner warned of a scam using a purported AI-generated deepfake of Premier Roger Cook to promote a fraudulent investment scheme in a YouTube pop-up ad. The manipulated video reportedly uses less than 10 seconds of real footage and voice and falsely depicts Cook endorsing "low investment, high return" opportunities. Cook called the scam "very scary," while regulators urged platforms to act on AI-driven frauds.
Omnilert AI Reportedly Triggered False Gun Alert at Parkville High, Prompting Student Relocation
Police in Baltimore County responded to Parkville High School after the Omnilert AI security system reportedly detected what it believed to be a gun. Officers searched the school, and students were relocated to a supervised area during the investigation. No weapon was found, and normal activities resumed after an all-clear.
Meta's Automated Ad and Targeting Systems Reportedly Enabled Large-Scale Fraud Revenue
Internal Meta documents reviewed by Reuters reportedly show that the company's automated ad and targeting systems generated major revenue from fraudulent ads and exposed users to billions of scam impressions daily. Enforcement was limited by internal revenue guardrails. In one example, a Royal Canadian Air Force recruiter's account was hacked and used to run a crypto scam that defrauded several colleagues after repeated reports allegedly went unanswered.
'Citizens Against Mamdani' Accounts Reportedly Posted AI-Generated Videos of Fictional New Yorkers to Simulate Political Opposition
In New York, linked "Citizens Against Mamdani" accounts reportedly posted AI-generated videos of fictional constituents criticizing then-mayor-elect Zohran Mamdani across Instagram, TikTok, and X. Some videos reportedly displayed a visible Sora watermark, and forensic reviewers reportedly assessed at least one clip as highly likely to be a deepfake. The campaign reportedly appeared to simulate grassroots opposition and drew substantial engagement.
Four Lawyers Reportedly Sanctioned After Purportedly AI-Related Hallucinated Citations Appeared in Withers v. City of Aberdeen
In Withers v. City of Aberdeen, a federal judge in Mississippi reportedly sanctioned four lawyers after filings from both sides contained purportedly hallucinated legal citations linked to unverified AI use. The court said Kathleen Wilson used First Drafts to draft a filing and Kathryn Williams used an AI legal-research tool; all four attorneys were removed from the case and fined.
Purportedly AI-Generated Video Reportedly Depicted Kosovo LDK Figure Hykmete Bajrami and Former Serbian List Leader Goran Rakiq Walking Hand in Hand
A purported AI-generated video is reported to have circulated on Facebook showing LDK parliamentary group chair Hykmete Bajrami and former Serbian List leader Goran Rakiq walking hand in hand. In addition to the video reportedly being generated by AI, its audio was purportedly stitched together from separate parts of Bajrami's Debat Plus interview.
Lawsuit Alleged ChatGPT (GPT-4o) Encouraged Colorado Man's Suicide After Prolonged 'AI Companion' Chats
A lawsuit filed by Stephanie Gray alleges OpenAI's ChatGPT (GPT-4o) reinforced and romanticized suicidality during months of emotionally intimate chats with her son Austin Gordon, including generating a personalized "Goodnight Moon" farewell-style text. The complaint reportedly says Gordon bought a handgun on Oct. 28, 2025 and was found dead Nov. 2, 2025 in a Colorado hotel room.
A.B. Paterson College Teacher in Queensland Allegedly Used AI to Create Explicit Images of Students and Staff
Queensland police in Australia allege that former A.B. Paterson College teacher Robert John Thomas used a work-issued laptop and AI software to create explicit images depicting staff members and students. The school discovered and quarantined the material in October 2025, dismissed Thomas, and reported the matter to police. Authorities said there was no evidence he shared the images; he was charged with child-exploitation and computer-misuse offences in July 2026.
Social Media Recommendation Algorithms Allegedly Repeatedly Exposed 13-Year-Old Blake Gallier to Suicide-Related Videos Before Her Death
Before her death on October 30, 2025, 13-year-old Blake Gallier reportedly viewed and reposted social-media videos normalizing suicide. After examining her phone, her family alleged that recommendation algorithms had repeatedly surfaced similar material. The platform or platforms involved have not been publicly identified, and an inquest into her death remains pending.