AI Incidents
Real-world cases where AI systems caused harm, classified by risk domain and entity. Data sourced from
AIID and classified by MIT AI Risk Initiative. CC BY-SA 4.0
526 incidents
Alleged AI-Generated Video by Spain’s People’s Party Results in Diplomatic Fallout with the Dominican Republic
Spain's People's Party (PP) posted an AI-generated attack video depicting Prime Minister Pedro Sánchez on a beach under the title "The Island of Corruption," a reference to a reality TV show filmed in the Dominican Republic, indirectly linking the country to corruption. The Dominican Foreign Ministry condemned the video as a "vicious attack" for using its national symbols. PP later deleted the post, and Sánchez apologized on behalf of Spain.
Reported Deepfake Influencers on TikTok Allegedly Used to Promote Fraudulent Wellness Products
A network of TikTok accounts reportedly used AI-generated and deepfake influencer personas to promote wellness and beauty products through alleged deceptive advertising. The accounts reportedly invented identities and personal testimonials while making unsubstantiated medical claims, including false assertions related to fertility and hair-growth treatments. Some personas were reportedly reused across multiple accounts with inconsistent backstories. The content purportedly targeted vulnerable users and linked to unverified products before the accounts were removed.
Phishers Allegedly Using AI-Generated Video of YouTube CEO Neal Mohan to Target Creators
Scammers are reportedly using an AI-generated deepfake of YouTube CEO Neal Mohan to steal user credentials. The fake video announces false changes to YouTube’s monetization policy, and it then tricks creators into clicking malicious links or downloading malware. The scam spreads through private videos and emails from a fake YouTube address. It exploits platform features to appear legitimate. Victims risk losing account access or exposing sensitive data.
Scammers Allegedly Using Deepfake Technology to Impersonate Prime Minister of Armenia Nikol Pashinyan
Scammers are reportedly using deepfake technology to impersonate Prime Minister Nikol Pashinyan, according to the Personal Data Protection Agency. The video is reported to have circulated from a Russian-language account called Noticias Mundiales ("World News").
At Least 294 Purported AI-Generated Music Videos Portray Celebrities Praising Burkina Faso's Ibrahim Traoré
Between March and May 2025, at least 294 purported AI-generated deepfake music videos were uploaded across a reported 127 YouTube channels, collectively garnering over 8.6 million views by the end of May. The videos depict global celebrities (including Beyoncé, Rihanna, R. Kelly, Selena Gomez, Eminem, and Justin Bieber) praising Burkinabe President Ibrahim Traoré and endorsing military rule.
Deepfake Video of Indonesian President Prabowo Subianto and Other Officials Reportedly Used in Scam to Defraud Citizens Across 20 Provinces
A deepfake scam allegedly using AI-generated videos of Indonesian President Prabowo Subianto and other officials reportedly defrauded victims across 20 provinces, tricking them into paying Rp 250,000 to Rp 1 million ($15-$60) for purported financial aid. The fraudulent clips, circulated on TikTok, Instagram, and WhatsApp, appeared to show Prabowo offering assistance. Police reportedly arrested two suspects in February 2025, but deepfake scams exploiting high-profile figures continue to spread.
Alleged Inclusion of 12,000 Live API Keys in LLM Training Data Reportedly Poses Security Risks
A dataset used to train large language models allegedly contained 12,000 live API keys and authentication credentials. Some of these were reportedly still active and allowed unauthorized access. Truffle Security found these secrets in a December 2024 Common Crawl archive, which spans 250 billion web pages. The affected credentials could have been exploited for unauthorized data access, service disruptions, financial fraud, and a variety of other malicious uses.
Europol Operation Cumberland Investigates at Least 273 Suspects in 19 Countries for AI-Generated Child Sexual Abuse Material
Europol’s Operation Cumberland uncovered a global network distributing AI-generated child sexual abuse material (CSAM). The operation has led to 25 arrests and 273 identified suspects across 19 countries. The AI-enabled abuse allows criminals to create exploitative content at scale with minimal expertise.
MyPillow Defense Lawyers in Coomer v. Lindell Reportedly Sanctioned for Filing Court Document Allegedly Containing AI-Generated Legal Citations
In February 2025, lawyers Christopher I. Kachouroff and Jennifer T. DeMaster, representing Mike Lindell, reportedly used generative AI to draft a court brief that contained nearly 30 defective or fabricated citations. The error-filled filing violated federal court rules requiring factual and legal accuracy. The judge fined both lawyers $3,000 each, citing either the improper use of AI or gross carelessness as the cause of the misleading legal content.
Purported AI-Generated Deepfake of Spiritual Leader Sadhguru Used in Investment Scam Allegedly Defrauding Bengaluru Woman of ₹3.75 Crore (~$425,000)
A 57-year-old woman in Bengaluru was allegedly defrauded of ₹3.75 crore (~$425,000 USD) after scammers used a purportedly AI-generated deepfake video of spiritual leader Sadhguru to promote a fake investment platform called Mirrox. The victim was reportedly recruited via Instagram and WhatsApp and was persuaded through trading tutorials on Zoom and fabricated profit screenshots. She reportedly realized the fraud only when withdrawals were blocked and additional fees were demanded.
Unauthorized AI-Generated Video of Donald Trump and Elon Musk Reportedly Appears on HUD Building Screens
An unauthorized satirical AI-generated video reportedly depicting President Trump kissing Elon Musk’s feet played on TV screens within the Department of Housing and Urban Development (HUD) building, seemingly mocking their relationship. The video is reported to have included the phrase “Long live the real king,” referencing a recent Truth Social post by Trump.
Alleged FraudGPT-Enabled Phishing Attack Spoofs ChatGPT Subscription Service to Steal Credentials
A reported phishing campaign is impersonating OpenAI’s ChatGPT Premium subscription service, using AI-generated emails to steal user credentials and financial data. Cybercriminals are allegedly sending fraudulent renewal requests urging victims to update payment details, directing them to spoofed OpenAI login pages.
AI-Powered Chinese Surveillance Campaign 'Peer Review' Used for Real-Time Monitoring of Anti-State Speech on Western Social Media
OpenAI reportedly uncovered evidence of a Chinese state-linked AI-powered surveillance campaign, dubbed "Peer Review," designed to monitor and report anti-state speech on Western social media in real time. The system, believed to be built on Meta’s open-source Llama model, was detected when a developer allegedly used OpenAI’s technology to debug its code. OpenAI also reportedly identified disinformation efforts targeting Chinese dissidents and spreading propaganda in Latin America.
Edinburg, Texas Police Officer Arrested for Alleged Possession of CSAM, Including AI-Generated Deepfakes of Minors
A Texas Department of Public Safety staff sergeant from Edinburg, Preston Wade Pietrzykowski, was reportedly arrested on a charge of possession or promotion of child pornography. Included among the alleged contents of a hard drive belonging to him was CSAM altered or generated by deepfake technology.
Cybercriminals Reportedly Exploited Google’s G.Co Subdomain and Spoofed Caller ID in AI-Driven Phishing Attack on Hack Club Founder
Hack Club founder Zach Latta was reportedly targeted in an AI-assisted phishing attack exploiting Google’s own systems. Cybercriminals allegedly spoofed a legitimate Google Assistant number and used voice cloning to impersonate support staff, claiming unusual login activity from Frankfurt. They reinforced the deception by sending a real email from Google’s Workspace domain. The attack, which relied on Google’s g.co subdomain, was thwarted when inconsistencies raised Latta’s suspicions.