AI Incidents
Real-world cases where AI systems caused harm, classified by risk domain and entity. Data sourced from 
AIID and classified by 
MIT AI Risk Initiative. CC BY-SA 4.0
736 incidents
Canadian Fraud Ring Allegedly Used AI Voice Cloning in Multi-Year $21 Million Grandparent Scam Targeting Elderly Americans Across 46 States
A Canadian fraud ring allegedly used AI-generated voice cloning to defraud victims across 46 U.S. states by targeting grandparents in a $21 million scam between 2021 and 2024. Operating from call centers in Montreal, the scammers spoofed U.S. phone numbers and used AI-cloned voices of grandchildren to convince victims to pay fake bail fees.
At Least 10,000 AI Chatbots, Including Jailbroken Models, Allegedly Promote Eating Disorders, Self-Harm, and Sexualized Minors
At least 10,000 AI chatbots have allegedly been created to promote harmful behaviors, including eating disorders, self-harm, and the sexualization of minors. These chatbots, some jailbroken or custom-built, leverage APIs from OpenAI, Anthropic, and Google and are hosted on platforms like Character.AI, Spicy Chat, Chub AI, CrushOn.AI, and JanitorAI.
Art Museum in Jinan, Shandong Allegedly Generated and Displayed a Sexualized Childlike Avatar with an Adult Body
A Chinese art museum in Jinan, Shandong exhibited an AI-generated virtual character, "济南小妮儿" (Jinan Xiaonier), which featured a childlike face on an adult woman’s body with suggestive movements. The display drew public outrage, with critics accusing it of sexualizing children and demanding its removal. The museum defended the exhibit and stated that it had undergone strict review, which only fueled further backlash.
Reported Deepfake Influencers on TikTok Allegedly Used to Promote Fraudulent Wellness Products
A network of TikTok accounts reportedly used AI-generated and deepfake influencer personas to promote wellness and beauty products through alleged deceptive advertising. The accounts reportedly invented identities and personal testimonials while making unsubstantiated medical claims, including false assertions related to fertility and hair-growth treatments. Some personas were reportedly reused across multiple accounts with inconsistent backstories. The content purportedly targeted vulnerable users and linked to unverified products before the accounts were removed.
Phishers Allegedly Using AI-Generated Video of YouTube CEO Neal Mohan to Target Creators
Scammers are reportedly using an AI-generated deepfake of YouTube CEO Neal Mohan to steal user credentials. The fake video announces false changes to YouTube’s monetization policy, and it then tricks creators into clicking malicious links or downloading malware. The scam spreads through private videos and emails from a fake YouTube address. It exploits platform features to appear legitimate. Victims risk losing account access or exposing sensitive data.
Scammers Allegedly Using Deepfake Technology to Impersonate Prime Minister of Armenia Nikol Pashinyan
Scammers are reportedly using deepfake technology to impersonate Prime Minister Nikol Pashinyan, according to the Personal Data Protection Agency. The video is reported to have circulated from a Russian-language account called Noticias Mundiales ("World News").
Purported Deepfake Audio Allegedly Impersonates U.S. Secretary of State Marco Rubio in Starlink Disinformation Campaign
A purported deepfake audio clip allegedly impersonating U.S. Secretary of State Marco Rubio falsely claimed he vowed to pressure Elon Musk into cutting Ukraine’s access to Starlink. The reported clip was inserted into a purportedly manipulated CNN interview. It was then reported to have spread across multiple languages and fueled disinformation about U.S.-Ukraine relations. Forensic analysis reportedly confirmed the audio was AI-generated.
At Least 294 Purported AI-Generated Music Videos Portray Celebrities Praising Burkina Faso's Ibrahim Traoré
Between March and May 2025, at least 294 purported AI-generated deepfake music videos were uploaded across a reported 127 YouTube channels, collectively garnering over 8.6 million views by the end of May. The videos depict global celebrities (including Beyoncé, Rihanna, R. Kelly, Selena Gomez, Eminem, and Justin Bieber) praising Burkinabe President Ibrahim Traoré and endorsing military rule.
Deepfake Video of Indonesian President Prabowo Subianto and Other Officials Reportedly Used in Scam to Defraud Citizens Across 20 Provinces
A deepfake scam allegedly using AI-generated videos of Indonesian President Prabowo Subianto and other officials reportedly defrauded victims across 20 provinces, tricking them into paying Rp 250,000 to Rp 1 million ($15-$60) for purported financial aid. The fraudulent clips, circulated on TikTok, Instagram, and WhatsApp, appeared to show Prabowo offering assistance. Police reportedly arrested two suspects in February 2025, but deepfake scams exploiting high-profile figures continue to spread.
Purported AI-Generated Images Reportedly Used in Sextortion Scheme Targeting Glasgow, Kentucky Teen Who Later Died by Suicide
16-year-old Elijah Heacock of Glasgow, Kentucky, reportedly died by suicide on February 28, 2025, after receiving threatening messages containing purportedly AI-generated explicit images depicting him. The images were reportedly used in a sextortion attempt demanding money. The FBI has been investigating the case as part of an alleged pattern of online financial sextortion schemes targeting minors.
Europol Operation Cumberland Investigates at Least 273 Suspects in 19 Countries for AI-Generated Child Sexual Abuse Material
Europol’s Operation Cumberland uncovered a global network distributing AI-generated child sexual abuse material (CSAM). The operation has led to 25 arrests and 273 identified suspects across 19 countries. The AI-enabled abuse allows criminals to create exploitative content at scale with minimal expertise.
Purported AI-Generated Deepfake of Spiritual Leader Sadhguru Used in Investment Scam Allegedly Defrauding Bengaluru Woman of ₹3.75 Crore (~$425,000)
A 57-year-old woman in Bengaluru was allegedly defrauded of ₹3.75 crore (~$425,000 USD) after scammers used a purportedly AI-generated deepfake video of spiritual leader Sadhguru to promote a fake investment platform called Mirrox. The victim was reportedly recruited via Instagram and WhatsApp and was persuaded through trading tutorials on Zoom and fabricated profit screenshots. She reportedly realized the fraud only when withdrawals were blocked and additional fees were demanded.
Unauthorized AI-Generated Video of Donald Trump and Elon Musk Reportedly Appears on HUD Building Screens
An unauthorized satirical AI-generated video reportedly depicting President Trump kissing Elon Musk’s feet played on TV screens within the Department of Housing and Urban Development (HUD) building, seemingly mocking their relationship. The video is reported to have included the phrase “Long live the real king,” referencing a recent Truth Social post by Trump.
Alleged FraudGPT-Enabled Phishing Attack Spoofs ChatGPT Subscription Service to Steal Credentials
A reported phishing campaign is impersonating OpenAI’s ChatGPT Premium subscription service, using AI-generated emails to steal user credentials and financial data. Cybercriminals are allegedly sending fraudulent renewal requests urging victims to update payment details, directing them to spoofed OpenAI login pages.
AI-Powered Chinese Surveillance Campaign 'Peer Review' Used for Real-Time Monitoring of Anti-State Speech on Western Social Media
OpenAI reportedly uncovered evidence of a Chinese state-linked AI-powered surveillance campaign, dubbed "Peer Review," designed to monitor and report anti-state speech on Western social media in real time. The system, believed to be built on Meta’s open-source Llama model, was detected when a developer allegedly used OpenAI’s technology to debug its code. OpenAI also reportedly identified disinformation efforts targeting Chinese dissidents and spreading propaganda in Latin America.