AI Incidents
Real-world cases where AI systems caused harm, classified by risk domain and entity. Data sourced from 
AIID and classified by 
MIT AI Risk Initiative. CC BY-SA 4.0
464 incidents
Alleged AI-Powered Call Center Breach Exposes Over 10 Million Conversations in the Middle East
An AI-powered call center platform in the Middle East reportedly experienced a significant data breach, allegedly exposing over 10 million conversations between consumers, operators, and AI agents. Attackers allegedly accessed the platform’s management dashboard, stealing sensitive data, including national ID documents. The breach poses reported risks such as phishing, identity theft, and social engineering attacks. The stolen data was reportedly listed for sale on the dark web.
Police Use of Facial Recognition Software Causes Wrongful Arrests Without Defendant Knowledge
Police departments across the U.S. have used facial recognition software to identify suspects in criminal investigations, leading to multiple false arrests and wrongful detentions. The software's unreliability, especially in identifying people of color, has resulted in misidentifications that were not disclosed to defendants. In some cases, individuals were unaware that facial recognition played a role in their arrest, violating their legal rights and leading to unjust detentions.
Fake AI 'Nudify' Sites Reportedly Linked to Malware Distribution by Russian Hacker Collective FIN7
The hacker group FIN7 is allegedly behind fake AI "nudify" websites distributing infostealer malware to users, according to an investigation by Silent Push. These sites are reported to lure individuals seeking deepfake AI tools into downloading malware disguised as software to "nudify" photos. The malware steals sensitive data from victims, which is used for extortion or financial fraud. FIN7's activity on this front reportedly marks the revival of a group previously declared defunct by the U.S. Department of Justice.
Students in Maltese Schools Reportedly Being Targeted by Deepfake Nudes
Beginning sometime in October 2024, students ranging in age from 12 to 20 in schools in Malta were targeted in deepfake nude incidents. The attackers have been superimposing the faces of some of the students over the bodies of naked girls or using "nudify" apps to "undress" the photos, which have reportedly been sent to the victims over WhatsApp in order to humiliate them or in some cases blackmail them.
L.A. Woman Reportedly Defrauded of $81,000 and $350,000 Condo Proceeds in Romance Scam Using Purported Deepfake Videos of Actor Steve Burton
In October 2024, Los Angeles resident Abigail Ruvalcaba was reportedly targeted in a romance scam using purported AI-generated deepfake videos and voice impersonations of actor Steve Burton. Believing she was in a relationship, she allegedly sent over $81,000 in cash, gift cards, and crypto, then sold her condo for $350,000 and transferred proceeds to the scammer. Her daughter intervened in February 2025, but the family now reportedly faces bankruptcy and legal battles to recover losses.
Jennifer Aniston’s Likeness Allegedly Exploited in Purported Deepfake Collagen Supplement Promotion
A purportedly AI-generated deepfake video featuring Jennifer Aniston falsely promoting collagen supplements reportedly circulated on Facebook, misleading viewers about her involvement. The video, reportedly created without her consent, used footage from a previous roundtable interview, purportedly modified by AI to advertise health products.
ChatGPT Reportedly Introduces Errors in Critical Child Protection Court Report
A child protection worker in Victoria, Australia reportedly used ChatGPT to draft a report submitted to the Children's Court. The purportedly AI-generated report contained inaccuracies and downplayed risks to the child, allegedly resulting in a privacy breach when sensitive information was shared with OpenAI.
Two Members of Highline Public Schools Community in King County, Washington Reportedly Targeted in Deepfake Kidnapping Scam
Two members of the Highline Public Schools community in Burien, a town in King County, Washington, were reportedly targeted in a deepfake kidnapping scam. Scammers allegedly used AI-generated voice cloning technology to convincingly mimic the voices of their family members. The scammers reportedly used the altered voices to claim they had been kidnapped and demanding a ransom be paid.
Russian Influence Operation Allegedly Uses AI to Create Fake Kamala Harris Campaign Website and Rhino-Hunting Hoax
A Russian disinformation campaign, linked to Storm-1516 and Kremlin propagandist John Mark Dougan, allegedly used AI-generated content to target Kamala Harris’s election bid. The operation included a fake campaign website promoting extreme policies and an AI-enhanced deepfake video falsely claiming Harris killed an endangered rhino in Zambia. The hoaxes were spread via Telegram, X, VK, and pro-Kremlin media outlets.
Scammers Allegedly Use AI-Generated Avatars to Impersonate Friends in Houston, Texas and Solicit Money
Two Houston women reported being targeted in an alleged scam involving AI-generated videos that appeared to depict trusted friends. The purported deepfake avatars were reportedly used via social media and messaging apps to solicit access codes and promote fraudulent sales. Victims are reported to have lost control of their accounts, and friends of the impersonated individuals sent money believing the videos were authentic.
Deepfake Reportedly Used in Attempted Real Estate Fraud in Hallandale Beach, Florida
A scammer reportedly used deepfake technology to impersonate the owner of a vacant Hallandale Beach, Florida lot during a Zoom call. The scam matched forged IDs to public property records and nearly succeeded in defrauding the buyer of $52,000. The image used in the deepfake was reportedly that of a missing woman named Margrit Pritchard.
Pieces Technologies' Clinical AI Systems Allegedly Marketed With Misleading Performance Claims
The Texas Attorney General announced a settlement with Pieces Technologies following allegations that the company misrepresented the accuracy of its healthcare AI systems used for clinical documentation. The state concluded that marketing claims about low error and hallucination rates may have misled hospitals and clinicians relying on the tools in patient care settings. The settlement imposed restrictions on future claims and required greater transparency around performance and risk.
Criminal Group Uses AI Deepfake Technology to Steal Personal Data in Hangzhou, Zhejiang
A criminal group in China used AI face-swapping technology to bypass face recognition systems on major platforms, steal personal data, and sell it to fraud syndicates. The group generated convincing video simulations from static photos to breach accounts, reportedly earning 200,000 yuan. After an investigation by the Hangzhou Public Security Bureau, four suspects were arrested across the provinces of Anhui, Guizhou, and Zhejiang.
AI 'Nudify' Apps Used as Tools for Blackmail and Extortion
AI 'nudify' apps are being used to generate hyperrealistic non-consensual nude photos of individuals, which are then exploited for extortion and harassment. These apps use generative AI to remove clothing from images and create convincing fakes, often distributed on platforms like Telegram. Victims are threatened or shamed using these AI-generated images, with little recourse for removal or legal action.
Music Producer Michael Smith Reportedly Arrested for Allegedly Using AI-Generated Songs in $10 Million Streaming Scam
Music producer Michael Smith was reportedly arrested for allegedly using AI-generated songs and fake streaming accounts to scam over $10 million in royalties from major music platforms. By purportedly creating hundreds of thousands of songs and employing bots to artificially inflate streams, Smith reportedly circumvented fraud detection systems. The scheme was reportedly exposed after suspicions arose regarding the rapid generation of music and streaming anomalies.