AI Incidents
Real-world cases where AI systems caused harm, classified by risk domain and entity. Data sourced from
AIID and classified by MIT AI Risk Initiative. CC BY-SA 4.0
538 incidents
Japanese Porn Depixelated by Man using Deepfake
A man allegedly unblurred, using deepfake technology, pixelated pornographic images and videos of pornographic actors, which violated Japan’s obscenity law requiring images of genitalia to be obscured.
Deepfake Images of Australian Teacher Hannah Grundy and 25 Others Created and Circulated Online by Former Friend
Australian teacher Hannah Grundy discovered her face had been superimposed onto pornographic images using AI deepfake technology, which were shared online alongside personal details. A former trusted friend, Andrew Thomas Hayler, was found responsible, targeting 26 women, including Grundy and close friends, over two years. Hayler pleaded guilty to multiple charges and was sentenced to nine years in prison.
WeChat Pay's Facial Recognition Security Evaded by Scammers Using Victims’ Social Media Content
In China, fraudsters bypassed facial-recognition security for online financial transactions on WeChat Pay by crafting identity-verification GIFs of victims from their selfies on WeChat Moments, a social media platform.
Reported AI-Assisted Influence Campaigns by GoLaxy Allegedly Targeting Hong Kong and Taiwan Political Discourse
Reportedly leaked documents reviewed by researchers and media allege that Chinese firm GoLaxy used its "GoPro" AI system in multiple influence campaigns. In 2020, it reportedly tracked 180,000 Twitter accounts to counter opposition to Hong Kong's National Security Law; in 2022–2023, it amplified praise for China's Zero Covid policy using purportedly fake Facebook accounts; and in late 2023, allegedly it advised on messaging to weaken Taiwan's Democratic Progressive Party.
Fake Accounts Using GAN Faces Deployed by Propaganda Campaign on Social Platforms
A pro-China propaganda campaign deployed fake accounts on Facebook, Twitter, and YouTube using GAN-synthesized faces to share and post comments on its content to gain wider circulation.
Kristen Bell Deepfaked in Non-Consensual AI-Generated Pornography
The actor Kristen Bell discovered that her likeness was exploited by creators of deepfake pornography, who shared their non-consensual sexual depictions of her on the Internet.
Indian Political App Tek Fog Allegedly Hijacked Trends and Manipulated Public Opinion on Other Social Media Platforms
The Indian political social media app Tek Fog allegedly allowed operatives affiliated with the ruling political party to hijack social media trends and manipulate public opinion on other apps such as Twitter and WhatsApp, which opposition parties denounced as a national security threat.
Climate Action Group Posted Deepfake of Belgian Prime Minister Urging Climate Crisis Action
A deepfake video showing the Belgium’s prime minister speaking of an urgent need to tackle the climate crises was released by a climate action group.
Autonomous Kargu-2 Drone Allegedly Remotely Used to Hunt down Libyan Soldiers
In Libya, a Turkish-made Kargu-2 aerial drone powered by a computer vision model was allegedly used remotely by forces backed by the Tripoli-based government to track down and attack enemies as they were running from rocket attacks.
BJP Used Deepfake Videos of Manoj Tiwari to Target Haryanvi Voters in 2020 Delhi Election
In February 2020, India's BJP used purported deepfake videos of party leader Manoj Tiwari to influence voters in the Delhi legislative election. The videos reportedly showed Tiwari delivering scripted campaign messages in Haryanvi and English, which are languages he did not speak, by altering his lip movements and voice. Distributed via thousands of WhatsApp groups, the deepfakes reportedly reached millions of voters without disclosure.
Reported AI-Cloned Voice Used to Deceive Hong Kong Bank Manager in Purported $35 Million Fraud Scheme
In January 2020, a Hong Kong-based bank manager for a Japanese company reportedly authorized $35 million in transfers after receiving a call from someone whose voice matched the company director's. According to Emirati investigators, scammers used AI-based voice cloning to impersonate the executive. The fraud allegedly involved at least 17 individuals and reportedly led to global fund transfers that triggered a UAE investigation. U.S. authorities were reportedly later asked to help trace part of the funds sent to U.S. banks.
Quantum AI and Related AI-Themed Investment Scams Reportedly Used Deepfake Endorsements and Spoofed Media Sites to Solicit Investments
Researchers have described a global AI-themed investment fraud ecosystem using deepfake videos, spoofed news sites, phishing pages, and phone outreach to impersonate celebrities, news outlets, and political leaders. Reports link the scheme to fake trading platforms including Quantum AI and related sites, and to cloaked adtech infrastructure used to route likely victims while hiding scam pages from scanners.
Bots Allegedly Made up Roughly Half of Twitter Accounts in Discussions Surrounding COVID-19 Related Issues
Bots by anonymous actors were found by researchers to make up roughly half of Twitter accounts participating in COVID-19 discussions, many of which posted tweets about “reopening America“.
Giorgia Meloni Reportedly Targeted by Deepfake Pornography
In 2020, alleged deepfake pornographic videos falsely depicting Italian Prime Minister Giorgia Meloni were uploaded to a U.S. website and viewed millions of times. At the time, she was leader of the Brothers of Italy but not yet PM. In 2024, now serving as PM, Meloni reportedly sued Alessio Scurosu, 40, and his father, Roberto Scurosu, 73, seeking €100,000 in damages. She testified in court, calling the act "a form of violence."
Uganda Deployed Huawei's Facial Recognition to Monitor Political Opposition and Protests
Huawei's AI systems involving facial recognition were reportedly deployed by the Ugandan government to monitor political opposition actors and anti-regime sentiments, which raised fears of surveillance and suppression of individual freedoms.