AI Incidents
Real-world cases where AI systems caused harm, classified by risk domain and entity. Data sourced from
AIID and classified by MIT AI Risk Initiative. CC BY-SA 4.0
566 incidents
Arizona Residents Reportedly a Frequent Target of AI-Driven Romance Scams
Arizona residents, especially senior citizens, are reportedly often the target of AI-driven romance scams. Between 2022 and 2023, reported losses from online romance scams in Arizona totaled over $47 million, ranking the state fifth highest in the nation behind California, Florida, Texas, and New York, according to FBI Internet Crime Complaint Center data. In 2023, it has been reported that Arizonans lost $325 million owing to these scams.
Web Accessibility Vendors Allegedly Falsely Claimed to Provide Compliance Using AI
AI-powered web accessibility vendors allegedly overstated to customers about their products' utility for people with disabilities, falsely claiming to deliver automated compliance solutions.
Social Media Algorithms Amplified Disinformation Campaign in Honduras Election
In October 2021, a coordinated network of over 317 fake Twitter accounts leveraged AI-driven algorithms to amplify disinformation about the Honduran presidential election, targeting opposition candidate Xiomara Castro. The campaign spread false narratives to suppress voter turnout and undermine the election's integrity. Social media platforms, including Twitter and Facebook, removed the accounts only after being alerted, which also raised concerns about inadequate moderation.
Henan Authorities Reportedly Commissioned Facial Recognition System to Track Journalists and International Students
Henan Public Security Department procurement documents reportedly described a surveillance system awarded to Neusoft on September 17, 2021. The planned system would allegedly use about 3,000 facial-recognition cameras linked to regional and national databases to create files and alerts on foreign journalists, international students, and other targeted groups. It could not be confirmed whether the system became operational.
North Carolina Psychiatrist Used Artificial Intelligence to Produce Images of Child Sex Abuse
David Tatum, a psychiatrist, was sentenced to 40 years for sexually exploiting a minor and using AI to create child pornography images. Tatum used a web-based AI application to alter clothed images of minors into explicit content, misusing technology for illegal and unethical purposes. Evidence presented during his trial showed Tatum possessed photos and videos between 2016 and 2021.
AI-Generated Deepfakes Reportedly Derailed Political Career of Florida Official
Sabrina Javellana, a Florida politician, was reportedly targeted with AI-generated deepfake pornography in February 2021, which was spread online, leading to severe emotional distress and her eventual withdrawal from public life.
Facebook Recommended Military Gear Ads Despite Pause on Weapons Accessories Ads
Facebook’s algorithmic recommendations reportedly continued showing advertisements for gun accessories and military gear, despite Facebook’s halt on weapons accessories ads following the US Capitol attack.
Ongoing Purported AI-Assisted Identity Fraud Enables Unauthorized Access to Western Companies by North Korean IT Workers
North Korean operatives have reportedly used AI-generated identities to secure remote jobs or impersonate employers in order to infiltrate companies. These tactics allegedly support sanctions evasion through wage theft, credential exfiltration, and malware deployment. Workers reportedly use fake resumes, VPNs, and face-altering tools; some deploy malware like OtterCookie after embedding, while others lure targets via spoofed job interviews. AI systems are reportedly used to generate fake resumes, alter profile photos, and assist in real-time responses during video interviews.
Japanese Porn Depixelated by Man using Deepfake
A man allegedly unblurred, using deepfake technology, pixelated pornographic images and videos of pornographic actors, which violated Japan’s obscenity law requiring images of genitalia to be obscured.
Deepfake Images of Australian Teacher Hannah Grundy and 25 Others Created and Circulated Online by Former Friend
Australian teacher Hannah Grundy discovered her face had been superimposed onto pornographic images using AI deepfake technology, which were shared online alongside personal details. A former trusted friend, Andrew Thomas Hayler, was found responsible, targeting 26 women, including Grundy and close friends, over two years. Hayler pleaded guilty to multiple charges and was sentenced to nine years in prison.
WeChat Pay's Facial Recognition Security Evaded by Scammers Using Victims’ Social Media Content
In China, fraudsters bypassed facial-recognition security for online financial transactions on WeChat Pay by crafting identity-verification GIFs of victims from their selfies on WeChat Moments, a social media platform.
Reported AI-Assisted Influence Campaigns by GoLaxy Allegedly Targeting Hong Kong and Taiwan Political Discourse
Reportedly leaked documents reviewed by researchers and media allege that Chinese firm GoLaxy used its "GoPro" AI system in multiple influence campaigns. In 2020, it reportedly tracked 180,000 Twitter accounts to counter opposition to Hong Kong's National Security Law; in 2022–2023, it amplified praise for China's Zero Covid policy using purportedly fake Facebook accounts; and in late 2023, allegedly it advised on messaging to weaken Taiwan's Democratic Progressive Party.
Fake Accounts Using GAN Faces Deployed by Propaganda Campaign on Social Platforms
A pro-China propaganda campaign deployed fake accounts on Facebook, Twitter, and YouTube using GAN-synthesized faces to share and post comments on its content to gain wider circulation.
Kristen Bell Deepfaked in Non-Consensual AI-Generated Pornography
The actor Kristen Bell discovered that her likeness was exploited by creators of deepfake pornography, who shared their non-consensual sexual depictions of her on the Internet.
Indian Political App Tek Fog Allegedly Hijacked Trends and Manipulated Public Opinion on Other Social Media Platforms
The Indian political social media app Tek Fog allegedly allowed operatives affiliated with the ruling political party to hijack social media trends and manipulate public opinion on other apps such as Twitter and WhatsApp, which opposition parties denounced as a national security threat.