AI Incidents
Real-world cases where AI systems caused harm, classified by risk domain and entity. Data sourced from
AIID and classified by MIT AI Risk Initiative. CC BY-SA 4.0
736 incidents
Australian Retailers Reportedly Captured Face Prints of Their Customers without Consent
Major Australian retailers reportedly analyzed in-store footage to capture facial features of their customers without consent, which was criticized by consumer groups as creepy and invasive.
Yahoo Boys Allegedly Employ Real-Time Deepfake Technology in Romance Scams
Scammers from Nigeria, known as "Yahoo Boys," are reportedly utilizing real-time deepfake technology to impersonate individuals during video calls, deceiving victims in romance scams. By allegedly altering their appearance with face-swapping software, they build trust under false identities to defraud targets of substantial sums.
Robbers Accessed Drugged Gay Men's Bank Accounts Using Their Phones' Facial Recognition
Gay men in New York City were drugged by robbers who accessed their phones using facial recognition while they were unconscious to transfer funds out of their bank accounts.
Google’s Assistive Writing Feature Provided Allegedly Unnecessary and Clumsy Suggestions
Google’s “inclusive language” feature prompting writers to consider alternatives to non-inclusive words reportedly also recommend alternatives for words such as “landlord” and “motherboard,” which critics said was a form of obtrusive, unnecessary, and bias-reinforcing speech-policing.
Northern Ireland MLA Cara Hunter Allegedly Targeted by Deepfake Pornography Ahead of May 2022 Assembly Election
Sometime in April 2022, reportedly some weeks before the May 5, 2022 Northern Ireland Assembly election, Member of the Legislative Assembly Cara Hunter was targeted in a deepfake pornography incident. A fake video depicting her in explicit scenarios is reported to have circulated widely on WhatsApp. Law enforcement have as of yet been unable to trace the origins of the video, according to reports. Additionally, it is alleged that about six months after the initial incident, she was the target of at least 15 more AI-generated deepfakes depicting her likeness in underwear.
AI-Generated Faces Used by Scammers to Pose as a Law Firm in Boston
GAN faces were allegedly used by scammers alongside a parked domain and a fake website to impersonate a Boston law firm.
Three Make-Up Artists Lost Jobs Following Black-Box Automated Decision by HireVue
Three make-up artists lost their positions following an algorithmically-assessed video interview by HireVue who reportedly failed to provide adequate explanation of the findings.
Deepfake Video of Ukrainian President Yielding to Russia Posted on Ukrainian Websites and Social Media
A quickly-debunked deepfaked video of the Ukrainian President Volodymyr Zelenskyy was posted on various Ukrainian websites and social media platforms encouraging Ukrainians to surrender to Russian forces during the Russia-Ukraine war.
Fake LinkedIn Profiles Created Using GAN Photos
More than a thousand inauthentic LinkedIn profiles using allegedly GAN-generated photos were notified by researchers at Stanford to LinkedIn’s staff, and many of which were removed for violating rules against creating fake profiles and falsifying information.
AI-Generated Profiles Used in Disinformation Campaign Targeting Ukrainians
According to security reports by Meta, fictitious personas with GAN-generated profile pictures were used by people operating in Russia and Ukraine to push a disinformation campaign targeting Ukrainian social media users, and were taken down.
'Pravda' Network, Successor to 'Portal Kombat,' Allegedly Seeding AI Models with Kremlin Disinformation
A purported Moscow-based disinformation network, Pravda, allegedly infiltrated AI models by flooding the internet with pro-Kremlin falsehoods. A NewsGuard audit found that 10 major AI chatbots repeated these narratives 33% of the time, citing Pravda sources as legitimate. The tactic, called "LLM grooming," manipulates AI training data to embed Russian propaganda. Pravda is part of Portal Kombat, a larger Russian disinformation network identified by VIGINUM in February 2024, but in operation since February 2022.
A Chinese Tech Worker at Zhihu Fired Allegedly via a Resignation Risk Prediction Algorithm
The firing of an employee at Zhihu, a large Q&A platform in China, was allegedly caused by the use of a behavioral perception algorithm which claimed to predict a worker’s resignation risk using their online footprints, such as browsing history and internal communication.
Uber Launched Opaque Algorithm That Changes Drivers' Payments in the US
Uber launched a new but opaque algorithm to determine drivers' pay in the US which allegedly caused drivers to experience lower fares, confusing fare drops, and a decrease in rides.
YouTuber Tested Tesla on Self Driving Mode, Colliding with Street Pylons
A YouTuber who was a Tesla’s employee conducted an on-road review of Tesla's Full Self Driving (FSD) Beta, showing its navigation in various road environments in San Jose and collision with a bollards during Autopilot, allegedly causing his dismissal from the company.
Replika's "AI Companions" Reportedly Abused by Its Users
Replika's AI-powered "digital companions" was allegedly abused by their users, who posted on Reddit abusive behaviors and interactions such as using slurs, roleplaying violent acts, and stimulating sexual abuse.