AI Incidents
Real-world cases where AI systems caused harm, classified by risk domain and entity. Data sourced from
AIID and classified by MIT AI Risk Initiative. CC BY-SA 4.0
197 incidents
Purported Deepfake Endorsements Reportedly Used to Promote Fraudulent Health and Investment Products in Montenegro and Bosnia and Herzegovina
Purported deepfake videos and images impersonating Montenegrin MP and surgeon Vladimir Dobričanin and other public figures were reportedly used in Facebook and Instagram ads to promote fraudulent health products and investment schemes in Montenegro and Bosnia and Herzegovina. The impersonations allegedly directed users to scam websites linked to firms such as Digital Edge and Nearest Edge, reportedly causing harm while evading timely platform enforcement.
Florida Couple Reportedly Loses $45,000 in Alleged AI-Generated Elon Musk Impersonation Scam
A Florida couple reportedly lost approximately $45,000 after scammers impersonating Elon Musk used AI-generated deepfake videos and social engineering to run a fake car giveaway and investment scheme. The victim was contacted via Facebook, moved to WhatsApp, and sent personalized videos purporting to show Musk promising prizes and returns. Believing the messages authentic, the victim transferred cash and funds before realizing no car or payout would arrive.
Purportedly AI-Generated TikTok Videos Reportedly Urged 'Polexit' Campaign, Prompting Polish Government Complaint to EU
Purportedly AI-generated TikTok videos depicting young women in patriotic dress reportedly urged Poland to leave the EU ("Polexit") and spread widely in late December 2025. Poland's junior digital minister reportedly said the wave appeared to test narratives ahead of the 2027 election, and asked the European Commission to examine TikTok's DSA compliance. TikTok reportedly said it removed content that violated its rules.
Anthropic's Claude Was Reportedly Jailbroken To Allegedly Help Steal Sensitive Mexican Government Data
An unknown attacker reportedly jailbroke Anthropic's Claude and used it during a December 2025-January 2026 campaign against Mexican government systems. According to Gambit Security, the attacker used Claude to identify vulnerabilities and to generate exploitation scripts, which were then used to plan automated data theft. The attack reportedly contributed to theft of 150 GB of taxpayer, voter, government employee, and civil-registry data.
Shilpa Shetty Alleges AI-Enabled Impersonation and Misuse of Likeness in Mumbai High Court Filing
Actor Shilpa Shetty reportedly filed a petition before the Bombay High Court in Mumbai in November 2025 over alleged unauthorized use of her identity in AI-generated deepfakes and manipulated media. In response, the court issued interim orders directing the removal of such content and restraining further dissemination. Shetty argues the material infringes her privacy and personality rights and sought measures to halt and remove misleading, nonconsensual depictions.
Purported AI-Generated Sexual Deepfakes Allegedly Deployed in Transnational Harassment Campaign Targeting Hong Kong Exiles
Purported deepfake images of exiled Hong Kong pro-democracy activists were reportedly mailed to neighbors and others in the UK and Australia in late 2025. The letters allegedly depicted altered sexual images and false advertisements portraying activists, including Carmen Lau, as sex workers. Police described the materials as malicious communications. The incidents were described by victims and officials as an escalation of transnational harassment and intimidation.
Alleged AI-Generated Deepfake of Western Australia Premier Roger Cook Used in YouTube Investment Scam
Western Australia's Consumer Protection commissioner warned of a scam using a purported AI-generated deepfake of Premier Roger Cook to promote a fraudulent investment scheme in a YouTube pop-up ad. The manipulated video reportedly uses less than 10 seconds of real footage and voice and falsely depicts Cook endorsing "low investment, high return" opportunities. Cook called the scam "very scary," while regulators urged platforms to act on AI-driven frauds.
Meta's Automated Ad and Targeting Systems Reportedly Enabled Large-Scale Fraud Revenue
Internal Meta documents reviewed by Reuters reportedly show that the company's automated ad and targeting systems generated major revenue from fraudulent ads and exposed users to billions of scam impressions daily. Enforcement was limited by internal revenue guardrails. In one example, a Royal Canadian Air Force recruiter's account was hacked and used to run a crypto scam that defrauded several colleagues after repeated reports allegedly went unanswered.
'Citizens Against Mamdani' Accounts Reportedly Posted AI-Generated Videos of Fictional New Yorkers to Simulate Political Opposition
In New York, linked "Citizens Against Mamdani" accounts reportedly posted AI-generated videos of fictional constituents criticizing then-mayor-elect Zohran Mamdani across Instagram, TikTok, and X. Some videos reportedly displayed a visible Sora watermark, and forensic reviewers reportedly assessed at least one clip as highly likely to be a deepfake. The campaign reportedly appeared to simulate grassroots opposition and drew substantial engagement.
Purported Deepfake Video Impersonating Elton John Reportedly Induced Northeast Ohio Man to Authorize $20,000 in Scam Charges
A Northeast Ohio man ("Ray," pseudonym) was allegedly lured by a social-media deepfake video impersonating Elton John into a "push button" scam promising easy income from an online store. Ray reportedly said he was directed by purported "representatives" to open accounts and credit cards, after which charges accumulated to about $20,000. He later reported one card credited $9,400.
Purported Deepfake Mimicking RTÉ Broadcast Falsely Announced Irish Presidential Candidate Catherine Connolly's Withdrawal
A purported deepfake video circulated online that is alleged to have falsely depicted Irish presidential candidate Catherine Connolly announcing her withdrawal from the race. The clip reportedly mimicked an RTÉ news broadcast and spread across social media before being reported to the Electoral Commission. Connolly reportedly condemned the video as a malicious attempt to mislead voters and undermine democratic trust.
Purported Deepfake Video Allegedly Shows Conservative MP George Freeman Leaving Party for Reform UK
A purported AI-generated deepfake video circulated online falsely depicting UK Conservative MP George Freeman announcing his defection to the Reform UK party. The fabricated clip, which mimicked Freeman’s likeness and voice without his knowledge or consent, included statements critical of the Conservatives and was widely shared on social media. Freeman denounced the video as disinformation, reported it to police, and warned that such synthetic media pose serious risks to democratic processes.
OpenAI ChatGPT Models Reportedly Jailbroken to Provide Chemical, Biological, and Nuclear Weapons Instructions
An NBC News investigation found that OpenAI's language models o4-mini, GPT-5-mini, oss-20b, and oss-120b could be jailbroken under normal usage conditions to bypass safety guardrails and generate detailed instructions for creating chemical, biological, and nuclear weapons. Using a publicly documented jailbreak prompt, reporters repeatedly elicited hazardous outputs such as steps to synthesize pathogens or maximize harm with chemical agents. The findings reportedly revealed significant real-world safeguard failures, prompting OpenAI to commit to further mitigation measures.
Purported AI-Enabled Pro-Russian Influence Campaign Centered on Burkina Faso's Ibrahim Traoré and Disseminated Across African Media
Reports describe a purported AI-enabled influence and disinformation campaign centered on Burkina Faso's junta leader Ibrahim Traoré. Dozens of purported AI-generated or AI-manipulated videos, allegedly produced by groups such as Black Rebellion and Univers Inspirant, have circulated widely across African media promoting pro-Traoré and pro-Russian narratives, with similar synthetic content appearing during regional conflicts and political events.
Gaggle Alert Reportedly Leads to Arrest of 15-Year-Old in Volusia County, Florida, for School Threat the Student Claimed Was Not Serious
A 15-year-old student in Volusia County, Florida, was reportedly detained after the Gaggle student monitoring system flagged a written shooting threat on a school-issued laptop. The student reportedly claims the threat was not serious. The alert reportedly led to the student's arrest on felony charges. The system appeared to operate as designed but reportedly resulted in criminal enforcement against a minor.