AI Incidents
Real-world cases where AI systems caused harm, classified by risk domain and entity. Data sourced from
AIID and classified by MIT AI Risk Initiative. CC BY-SA 4.0
1,751 incidents
AI-Generated Fake News Targets Black Celebrities on YouTube
YouTube faced a surge of AI-generated fake news targeting Black celebrities, including fake narratives about Sean “Diddy” Combs and others. These videos, blending AI-generated and manipulated media, amassed millions of views, challenging content moderation efforts and highlighting the spread of disinformation.
Alleged ChatGPT Account Compromise Reportedly Led to Unintended Data Exposure
An alleged security breach involving ChatGPT led to the reported exposure of sensitive conversations, including login credentials and personal data, after a user account was allegedly compromised. OpenAI reportedly responded to the incident with an explanation.
Nine Network's AI Alters Lawmaker Georgie Purcell's Image Inappropriately
The Nine Network used Photoshop's Generative Expand AI tool to resize an image of lawmaker Georgie Purcell, inadvertently altering her attire to appear more revealing. This error, claimed to result from the AI's automation, led to public criticism and an apology from the network.
Purported Deepfake of Andrew Forrest Used to Promote Fraudulent 'Quantum AI' Crypto Platform on Facebook
Cybertrace reportedly identified a purported deepfake of Australian billionaire Andrew Forrest circulating on Facebook on January 27, 2024, falsely depicting him endorsing a fraudulent crypto platform called Quantum AI. The video reportedly altered footage from a 2023 Rhodes Trust talk. Forrest reportedly condemned Meta for failing to curb AI-generated frauds.
Scammers Reportedly Used Deepfake Videos to Blackmail a TikTok User Posting About Bhutan
A TikTok user who posted about missing Bhutan while living abroad reportedly faced blackmail involving manipulated videos described as deepfakes. Scammers allegedly sent the videos to some of his contacts after he initially dismissed their threats. The episode reportedly caused distress. The AI tool and his country of residence were not identified.
Significant Increase in Deepfake Nudes of Taylor Swift Circulating on Social Media
AI-generated sexually explicit images of Taylor Swift circulated on X, garnering over 45 million views before removal. Originating from a Telegram group, these deepfakes challenge content moderation, as X's policies against synthetic media and nonconsensual nudity were violated.
Deepfakes of Deceased Indian Politicians for Election Campaigning Are Increasingly Being Deployed
In the lead-up to India's 2024 general elections, AI technology was used to create deepfake videos of deceased politicians, such as M. Karunanidhi and J. Jayalalithaa, aiming to influence voter behavior and campaign strategies. These AI-generated appearances are contributing to the erosion of trust in democratic processes and media discourse.
Fake Biden Voice in Robocall Misleads New Hampshire Democratic Voters in 2024 Primary Election
A robocall imitating President Biden's voice urged New Hampshire Democrats to skip the 2024 primary, falsely claiming their votes mattered more in November. Investigators with the New Hampshire Attorney General's Office, along with other state AGs, the Industry Traceback Group, and the FCC determined that political consultant Steve Kramer hired Paul Carpenter to create the deepfake, which was distributed by Walter Monk's company, Life Corporation. Rep. Dean Phillips, who employed Kramer, has distanced himself from the incident. Kathy Sullivan, the former New Hampshire Democratic Party chair, was falsely impersonated in the caller ID data used for the robocalls.
Chatbot for DPD Malfunctioned and Swore at Customers and Criticized Its Own Company
DPD's AI chatbot, used for customer service, appeared to malfunction following a system update, leading to inappropriate responses including swearing and criticizing the company. The incident, which became viral on social media, occurred after the chatbot was updated, prompting DPD to disable the malfunctioning AI component.
Purportedly AI-Manipulated Medical Scam Advertisement Reportedly Used Bulgarian TV Host and Physician's Likenesses
A purportedly AI-manipulated scam advertisement circulating online appeared to use the likenesses and altered media of Bulgarian television host Simeon Ivanov and physician Spas Spaskov to promote an unregistered purported joint-treatment product. They reportedly denied involvement, and the product was described in reporting as ineffective.
High School Athletic Director in Baltimore County Allegedly Created Racist Deepfake Audio Impersonating Principal
Dazhon Darien, former athletic director at Pikesville High School in Baltimore, allegedly used AI to create a purported deepfake audio clip impersonating Principal Eric Eiswert, embedding racist and antisemitic remarks. According to reports, the clip was intended to discredit Eiswert and was widely circulated, with some accounts linking it to threats and his placement on administrative leave. On April 28, 2025, Darien was reportedly sentenced to four months in jail after pleading guilty to disturbing school operations.
Purported Deepfake Audio Reportedly Sparks False Claims of Biden Threatening Texas with F-15s
A purportedly AI-generated audio clip imitating President Biden’s voice reportedly circulated on social media, falsely suggesting that he had threatened to deploy F-15 fighter jets against Texas. The manipulated recording was widely shared and is reported to have heightened political tensions and spread misinformation.
Proliferation of Products on Amazon Titled with ChatGPT Error Messages
Products named after ChatGPT error messages are proliferating on Amazon, such as lawn chairs and religious texts. These names, often resembling AI-generated errors, indicate a lack of editing and undermine the sense of authenticity and reliability of product listings.
Scams Reportedly Impersonating Wealthy Investors Proliferating on Facebook
Scams are reportedly proliferating throughout Facebook impersonating wealthy individuals such as Bill Ackman, Cathie Wood, Steve Cohen, Peter Lynch, and Ray Dalio. In some cases, it seems deepfake technology is being employed, while simultaneously Facebook's own AI systems are allegedly faltering in their ability to halt the spread of these fraudulent ads despite being reported.
Milwaukee Police Detective Allegedly Used Flock Safety License-Plate Reader 20 Times to Track Two People in Violation of Department Policy
A Milwaukee County criminal complaint alleges that Police Detective Tehrangi Chapman used Flock Safety license-plate readers 20 times to track two people from January 2024 to January 2025, entering "test" or "training" as search reasons. The complaint says Chapman later admitted using Flock to track both people in violation of Milwaukee Police Department policy. He was charged with misconduct in public office; a separate count concerned an unauthorized GPS tracker.