AI Incidents
Real-world cases where AI systems caused harm, classified by risk domain and entity. Data sourced from 
AIID and classified by 
MIT AI Risk Initiative. CC BY-SA 4.0
566 incidents
Unauthorized AI-Generated Video of Donald Trump and Elon Musk Reportedly Appears on HUD Building Screens
An unauthorized satirical AI-generated video reportedly depicting President Trump kissing Elon Musk’s feet played on TV screens within the Department of Housing and Urban Development (HUD) building, seemingly mocking their relationship. The video is reported to have included the phrase “Long live the real king,” referencing a recent Truth Social post by Trump.
Alleged FraudGPT-Enabled Phishing Attack Spoofs ChatGPT Subscription Service to Steal Credentials
A reported phishing campaign is impersonating OpenAI’s ChatGPT Premium subscription service, using AI-generated emails to steal user credentials and financial data. Cybercriminals are allegedly sending fraudulent renewal requests urging victims to update payment details, directing them to spoofed OpenAI login pages.
AI-Powered Chinese Surveillance Campaign 'Peer Review' Used for Real-Time Monitoring of Anti-State Speech on Western Social Media
OpenAI reportedly uncovered evidence of a Chinese state-linked AI-powered surveillance campaign, dubbed "Peer Review," designed to monitor and report anti-state speech on Western social media in real time. The system, believed to be built on Meta’s open-source Llama model, was detected when a developer allegedly used OpenAI’s technology to debug its code. OpenAI also reportedly identified disinformation efforts targeting Chinese dissidents and spreading propaganda in Latin America.
Edinburg, Texas Police Officer Arrested for Alleged Possession of CSAM, Including AI-Generated Deepfakes of Minors
A Texas Department of Public Safety staff sergeant from Edinburg, Preston Wade Pietrzykowski, was reportedly arrested on a charge of possession or promotion of child pornography. Included among the alleged contents of a hard drive belonging to him was CSAM altered or generated by deepfake technology.
Cybercriminals Reportedly Exploited Google’s G.Co Subdomain and Spoofed Caller ID in AI-Driven Phishing Attack on Hack Club Founder
Hack Club founder Zach Latta was reportedly targeted in an AI-assisted phishing attack exploiting Google’s own systems. Cybercriminals allegedly spoofed a legitimate Google Assistant number and used voice cloning to impersonate support staff, claiming unusual login activity from Frankfurt. They reinforced the deception by sending a real email from Google’s Workspace domain. The attack, which relied on Google’s g.co subdomain, was thwarted when inconsistencies raised Latta’s suspicions.
Nonconsensual Explicit AI-Generated Images of Up to 60 Gladstone Park Secondary College Students in Victoria, Australia, Reportedly Created and Circulated Online
Purportedly AI-generated explicit images of up to 60 female students at Gladstone Park Secondary College in Victoria, Australia, were reportedly created and circulated online. The images were reportedly altered from formal school photos using AI tools to produce nonconsensual explicit content. Two Year 11 students have been suspended, but the full number of individuals involved remains unclear as the investigation is ongoing.
Two 16-Year-Old Students in Athens, Greece Allegedly Generated Nonconsensual Deepfake Pornography of Their Classmates
In Athens, Greece, two 16-year-old students were arrested for allegedly generated nonconsensual deepfake pornography of their classmates. They reportedly used images taken from social media to create the explicit images, which they are then reported to have disseminated online to others. The parents of the students were reportedly also arrested for neglecting to supervise their behavior.
Alleged Use of Purported AI-Generated Identities to Defraud FTX Claims Buyers of $5.6M
An individual or group allegedly used AI-based face modification tools to impersonate FTX claimants in video calls, reportedly defrauding two companies of over $5.6 million in the secondary claims market. The perpetrator reportedly used forged IDs, deepfake-style visuals, and claim data likely obtained from public records or a prior breach at Kroll. Funds were alleged to have been laundered through exchanges including Binance, CoinEx, and Gate.io.
Reported Deepfake of Maltese Prime Minister Robert Abela and Journalist Mark Laurence Zammit Used to Promote Fraudulent Investment
A deepfake scam allegedly used AI-generated audio to mimic Maltese Prime Minister Robert Abela and journalist Mark Laurence Zammit, falsely portraying them as endorsing an investment scheme. The fraudulent video repurposed genuine interview footage from 2022 but replaced the original dialogue with AI-generated voices.
AI-Driven Phishing Scam Uses Deepfake Robocalls to Target Gmail Users in Credential Theft Campaign
A sophisticated AI-powered phishing scam has reportedly been targeting between 1.8 to 2.5 billion Gmail users, allegedly using deepfake robocalls and phishing emails to steal credentials. Attackers impersonate Google security. They claim suspicious account activity and direct victims to fake Google login pages. The stolen credentials have reportedly been used for identity theft, banking fraud, and session hijacking. The FBI has urged vigilance as AI increases the scale and effectiveness of such attacks.
Purported Deepfake Images of Gráinne Seoige Reportedly Circulated During Ireland's 2024 General Election Campaign
A reported deepfake abuse campaign targeted Gráinne Seoige during her run in Ireland's 2024 general election campaign, when pornographic, purportedly AI-generated images of her were reportedly circulated online. Seoige later described the experience as humiliating and traumatic, and Gardaí said they were investigating the distribution of the material.
Teenager in Palma de Mallorca Allegedly Generated and Distributed Deepfake Nudes of Five Classmates
A teenager in Palma de Mallorca, Spain allegedly generated deepfake nudes of five classmates, reportedly taking their images from social media and using AI to alter them without their consent. He is reported to have shared the altered images with others.
Purported AI-Generated Videos Impersonating President of Malta Myriam Spiteri Debono Circulate on Social Media in Alleged Crypto Scam Campaigns
The Office of the President of Malta issued a public warning about purported deepfake videos and fabricated images impersonating President Myriam Spiteri Debono. The alleged AI-generated content was reportedly used to promote fraudulent financial schemes, primarily involving cryptocurrency, across social media platforms.
Alleged Deepfake Video Falsely Depicts Hollywood Stars in AI-Manipulated Protest Against Kanye West
A deepfake video allegedly depicted Scarlett Johansson, Jerry Seinfeld, David Schwimmer, Lisa Kudrow, Steven Spielberg, Adam Sandler, Sacha Baron Cohen, Natalie Portman, Jake Gyllenhaal, Lenny Kravitz, Adam Levine, Drake, Mark Zuckerberg, Jack Black, Mila Kunis, Ben Stiller, and Woody Allen protesting Kanye West’s antisemitic remarks. The video falsely attributed statements to them, using AI to manipulate their likenesses without consent.
AI-Generated Voice Purporting to Be Daughter Allegedly Used to Coerce $2,000 from Colorado Mother
In February 2025, a Colorado woman was scammed by a voice-cloning fraud in which criminals used what sounded like her daughter’s voice to stage a fake kidnapping. Under duress and believing her daughter was in danger, she wired $2,000 to Mexico. The scammers exploited generative AI to simulate the daughter’s voice and manipulated the victim psychologically. Law enforcement could not trace the perpetrators or recover the funds.