AI Incidents
Real-world cases where AI systems caused harm, classified by risk domain and entity. Data sourced from
AIID and classified by MIT AI Risk Initiative. CC BY-SA 4.0
197 incidents
Russian Disinformation Campaign Reportedly Used AI-Generated Posts and Videos to Target 2025 Moldovan Parliamentary Elections
Researchers and European officials reported that Russian operatives have been using purportedly AI-generated posts, videos, and websites to influence Moldova's September 2025 parliamentary elections. Networks of over 900 accounts across TikTok, Facebook, Instagram, Telegram, and YouTube have reportedly spread fabricated narratives, including reportedly misogynistic and false smears of President Maia Sandu.
Philippines Senate Hearing Featured Reports of Purported AI-Generated Deepfake Pornography Targeting Actress Angel Aquino and Content Creator Queen Hera's Daughter
In Manila, actress Angel Aquino reportedly said in a hearing how AI-generated deepfake porn video unlawfully used her face. She reportedly testified at a Senate hearing led by Sen. Risa Hontiveros and urged punishment for creators and those sharing the purported deepfakes. Influencer Queen Hera also reported a deepfake image of her daughter on the dark web; tools and perpetrators were reportedly not identified.
Nigeria-Based YouTube Network Allegedly Uses AI Voiceovers and Anchors to Amplify Pro-Kremlin Narratives
A network of five Nigeria-based YouTube channels reportedly drew millions of views while purportedly amplifying Kremlin-aligned narratives. The channels allegedly used AI-generated anchors and synthetic voiceovers to present repurposed interviews with pro-Russian commentators Scott Ritter and Douglas Macgregor. Attribution of the network's motives and funding remains uncertain, with reported possibilities ranging from freelance monetization to proxy involvement in influence operations.
Joann Fabrics Shoppers Reportedly Defrauded by AI-Generated Scam Sites, Part of Purported Wave of ~100,000 Fake Domains Across 194 Brands
Consumers were allegedly defrauded by AI-generated scam websites impersonating Joann Fabrics following the retailer's bankruptcy. The alleged impostor sites reportedly used Joann's branding to steal credit card details and personal data and leaving victims without products. Cybersecurity firm Netcraft estimated that nearly 100,000 domains created with AI tools were impersonating 194 brands, accounting for a reported 6–7% of global phishing activity.
New Zealand Financial Markets Authority (FMA), Te Mana Tātai Hokohoko, Reportedly Flags Purported Deepfake Pump-and-Dump Network Using Social Media Ads
The New Zealand Financial Markets Authority (FMA), Te Mana Tātai Hokohoko, reportedly warned of a global AI-enabled "pump-and-dump" scam that used purported deepfake videos of prominent New Zealand business leaders in Facebook and Instagram ads to lure investors into fake WhatsApp investment groups. Victims were allegedly urged to buy low-value foreign shares to inflate prices, then defrauded through a follow-on "recovery" scam.
Google AI Overviews and ChatGPT Reportedly Cited Fraudulent Cruise Hotline, Allegedly Enabling Successful Scam
Google's AI Overviews allegedly surfaced a fraudulent customer service number for Royal Caribbean. Consumer Alex Rivlin reportedly called the number, spoke with an impostor, and provided his credit card, later incurring $768 in fraudulent charges. The same number reportedly appeared in ChatGPT results and was linked to Disney and Princess cruises, purportedly showing how scammers are manipulating AI outputs to amplify longstanding hotline scams.
Purported Oprah Deepfake Reportedly Induced Utah Woman to Buy Misrepresented Weight Loss Supplements
A Utah woman, Lisa Swearingen, reported paying more than $400 for weight loss supplements after seeing online ads featuring a purported Oprah Winfrey deepfake endorsement. When the product arrived, she said its primary ingredient was turmeric rather than the advertised formula.
Grok Imagine Reportedly Produces Nonconsensual Taylor Swift Deepfake Nudes Without Explicit Prompting
The Verge reported that xAI's Grok Imagine video generator allegedly produced nonconsensual deepfake nudes of Taylor Swift without explicit prompting. Journalist Jess Weatherbed reportedly stated the images appeared the first time she used "spicy" mode on a Coachella-themed prompt, without attempting to circumvent safeguards.
Purportedly AI-Generated Image of British Army Colonels Captured in Ukraine Reportedly Circulates in Russian Media
Purported Russian-aligned outlet EADaily published an unverified claim that two British Army colonels had been captured in Ukraine, supported by a reportedly AI-generated image that contained visual and textual anomalies, and the named individuals ("Edward Blake" and "Richard Carroll") reportedly do not appear in UK military records. No credible evidence reportedly supports the claim; it was allegedly amplified by aligned websites and political figures as part of a disinformation pattern.
Azerbaijani Media Agency Reportedly Warned Purported Deepfake Videos Attributed to Defense and Foreign Ministers Claimed Belarusian Plane Was Downed in Russian Airspace
Azerbaijan's Media Development Agency reported that purportedly AI-generated deepfake videos circulated on social media appearing to show statements by Azerbaijan's defense and foreign ministers (Zakir Hasanov and Jeyhun Bayramov, respectively) about the alleged downing of a Belarusian aircraft in Russian airspace. The agency reportedly denied the videos were authentic and called them an information manipulation effort aimed at misleading public opinion.
Alleged Unauthorized Deepfake AI Clones of Ravish Kumar Used to Spread Purportedly Fabricated News on YouTube
Prominent Indian journalist Ravish Kumar reported that multiple YouTube channels are using purported deepfakes to mimic his face and voice, spreading fabricated and nonsensical news in his name. Kumar warned viewers not to trust these channels, filed complaints with YouTube, and is awaiting action.
Reported Deepfakes of Ukrainian Deputy PM Olha Stefanishyna Allegedly Supporting Fictional Mobilization Plan for Women
In late June 2025, Russian Telegram channels reportedly circulated deepfake videos claiming that Deputy Prime Minister Olha Stefanishyna backed mandatory mobilization of up to one million Ukrainian women starting September 1. Officials reportedly debunked the claim, confirming no such plans or laws exist. The disinformation operation reportedly aimed to incite panic and destabilize Ukraine's domestic situation.
Alleged AI Deepfake Videos Used to Lure Simcoe County, Ontario Residents in Crypto Scam
Multiple residents in Simcoe County, Ontario, have reportedly lost tens of thousands of dollars each after encountering purportedly AI-generated deepfake videos online that depict trusted public figures endorsing crypto investments. According to MP Adam Chambers and local reports, these manipulated ads misled victims into transferring funds through legitimate exchanges to fraudulent wallets.
Reported AI-Generated Video Call Impersonation of Cryptocurrency Analyst Leads to Alleged Malware Installation and Account Theft
Cryptocurrency analyst Mai Fujimoto reported losing access to her X, Telegram, and MetaMask accounts through a video call with a purported deepfake impersonating a trusted contact. According to Fujimoto, the attacker, who appeared on Zoom as her acquaintance, instructed her to install software under the guise of resolving an audio issue. Fujimoto believes this enabled malware installation. In response, Binance founder Changpeng Zhao warned such attacks render video call verification unreliable.
Purported Deepfake of Sri Lankan President Anura Kumara Dissanayake Promotes Alleged Fraudulent Government Investment Scheme
A reported deepfake depicts Sri Lankan President Anura Kumara Dissanayake endorsing a government investment plan. It reportedly uses manipulated footage from a May 3rd Satana TV program, dubbed or voice-cloned into English, and including a news article imitating the Daily Mirror to lure people to sign up for the scheme. Sri Lanka CERT, journalists, and the Presidential Media Division reportedly confirmed the video and associated links were AI-generated and part of a phishing and scam operation.