AI Incidents
Real-world cases where AI systems caused harm, classified by risk domain and entity. Data sourced from 
AIID and classified by 
MIT AI Risk Initiative. CC BY-SA 4.0
368 incidents
Reported Deepfake Influencers on TikTok Allegedly Used to Promote Fraudulent Wellness Products
A network of TikTok accounts reportedly used AI-generated and deepfake influencer personas to promote wellness and beauty products through alleged deceptive advertising. The accounts reportedly invented identities and personal testimonials while making unsubstantiated medical claims, including false assertions related to fertility and hair-growth treatments. Some personas were reportedly reused across multiple accounts with inconsistent backstories. The content purportedly targeted vulnerable users and linked to unverified products before the accounts were removed.
Phishers Allegedly Using AI-Generated Video of YouTube CEO Neal Mohan to Target Creators
Scammers are reportedly using an AI-generated deepfake of YouTube CEO Neal Mohan to steal user credentials. The fake video announces false changes to YouTube’s monetization policy, and it then tricks creators into clicking malicious links or downloading malware. The scam spreads through private videos and emails from a fake YouTube address. It exploits platform features to appear legitimate. Victims risk losing account access or exposing sensitive data.
Scammers Allegedly Using Deepfake Technology to Impersonate Prime Minister of Armenia Nikol Pashinyan
Scammers are reportedly using deepfake technology to impersonate Prime Minister Nikol Pashinyan, according to the Personal Data Protection Agency. The video is reported to have circulated from a Russian-language account called Noticias Mundiales ("World News").
At Least 294 Purported AI-Generated Music Videos Portray Celebrities Praising Burkina Faso's Ibrahim Traoré
Between March and May 2025, at least 294 purported AI-generated deepfake music videos were uploaded across a reported 127 YouTube channels, collectively garnering over 8.6 million views by the end of May. The videos depict global celebrities (including Beyoncé, Rihanna, R. Kelly, Selena Gomez, Eminem, and Justin Bieber) praising Burkinabe President Ibrahim Traoré and endorsing military rule.
Deepfake Video of Indonesian President Prabowo Subianto and Other Officials Reportedly Used in Scam to Defraud Citizens Across 20 Provinces
A deepfake scam allegedly using AI-generated videos of Indonesian President Prabowo Subianto and other officials reportedly defrauded victims across 20 provinces, tricking them into paying Rp 250,000 to Rp 1 million ($15-$60) for purported financial aid. The fraudulent clips, circulated on TikTok, Instagram, and WhatsApp, appeared to show Prabowo offering assistance. Police reportedly arrested two suspects in February 2025, but deepfake scams exploiting high-profile figures continue to spread.
Europol Operation Cumberland Investigates at Least 273 Suspects in 19 Countries for AI-Generated Child Sexual Abuse Material
Europol’s Operation Cumberland uncovered a global network distributing AI-generated child sexual abuse material (CSAM). The operation has led to 25 arrests and 273 identified suspects across 19 countries. The AI-enabled abuse allows criminals to create exploitative content at scale with minimal expertise.
Purported AI-Generated Deepfake of Spiritual Leader Sadhguru Used in Investment Scam Allegedly Defrauding Bengaluru Woman of ₹3.75 Crore (~$425,000)
A 57-year-old woman in Bengaluru was allegedly defrauded of ₹3.75 crore (~$425,000 USD) after scammers used a purportedly AI-generated deepfake video of spiritual leader Sadhguru to promote a fake investment platform called Mirrox. The victim was reportedly recruited via Instagram and WhatsApp and was persuaded through trading tutorials on Zoom and fabricated profit screenshots. She reportedly realized the fraud only when withdrawals were blocked and additional fees were demanded.
Unauthorized AI-Generated Video of Donald Trump and Elon Musk Reportedly Appears on HUD Building Screens
An unauthorized satirical AI-generated video reportedly depicting President Trump kissing Elon Musk’s feet played on TV screens within the Department of Housing and Urban Development (HUD) building, seemingly mocking their relationship. The video is reported to have included the phrase “Long live the real king,” referencing a recent Truth Social post by Trump.
Alleged FraudGPT-Enabled Phishing Attack Spoofs ChatGPT Subscription Service to Steal Credentials
A reported phishing campaign is impersonating OpenAI’s ChatGPT Premium subscription service, using AI-generated emails to steal user credentials and financial data. Cybercriminals are allegedly sending fraudulent renewal requests urging victims to update payment details, directing them to spoofed OpenAI login pages.
AI-Powered Chinese Surveillance Campaign 'Peer Review' Used for Real-Time Monitoring of Anti-State Speech on Western Social Media
OpenAI reportedly uncovered evidence of a Chinese state-linked AI-powered surveillance campaign, dubbed "Peer Review," designed to monitor and report anti-state speech on Western social media in real time. The system, believed to be built on Meta’s open-source Llama model, was detected when a developer allegedly used OpenAI’s technology to debug its code. OpenAI also reportedly identified disinformation efforts targeting Chinese dissidents and spreading propaganda in Latin America.
Edinburg, Texas Police Officer Arrested for Alleged Possession of CSAM, Including AI-Generated Deepfakes of Minors
A Texas Department of Public Safety staff sergeant from Edinburg, Preston Wade Pietrzykowski, was reportedly arrested on a charge of possession or promotion of child pornography. Included among the alleged contents of a hard drive belonging to him was CSAM altered or generated by deepfake technology.
Cybercriminals Reportedly Exploited Google’s G.Co Subdomain and Spoofed Caller ID in AI-Driven Phishing Attack on Hack Club Founder
Hack Club founder Zach Latta was reportedly targeted in an AI-assisted phishing attack exploiting Google’s own systems. Cybercriminals allegedly spoofed a legitimate Google Assistant number and used voice cloning to impersonate support staff, claiming unusual login activity from Frankfurt. They reinforced the deception by sending a real email from Google’s Workspace domain. The attack, which relied on Google’s g.co subdomain, was thwarted when inconsistencies raised Latta’s suspicions.
Nonconsensual Explicit AI-Generated Images of Up to 60 Gladstone Park Secondary College Students in Victoria, Australia, Reportedly Created and Circulated Online
Purportedly AI-generated explicit images of up to 60 female students at Gladstone Park Secondary College in Victoria, Australia, were reportedly created and circulated online. The images were reportedly altered from formal school photos using AI tools to produce nonconsensual explicit content. Two Year 11 students have been suspended, but the full number of individuals involved remains unclear as the investigation is ongoing.
Two 16-Year-Old Students in Athens, Greece Allegedly Generated Nonconsensual Deepfake Pornography of Their Classmates
In Athens, Greece, two 16-year-old students were arrested for allegedly generated nonconsensual deepfake pornography of their classmates. They reportedly used images taken from social media to create the explicit images, which they are then reported to have disseminated online to others. The parents of the students were reportedly also arrested for neglecting to supervise their behavior.
Alleged Use of Purported AI-Generated Identities to Defraud FTX Claims Buyers of $5.6M
An individual or group allegedly used AI-based face modification tools to impersonate FTX claimants in video calls, reportedly defrauding two companies of over $5.6 million in the secondary claims market. The perpetrator reportedly used forged IDs, deepfake-style visuals, and claim data likely obtained from public records or a prior breach at Kroll. Funds were alleged to have been laundered through exchanges including Binance, CoinEx, and Gate.io.