AI Incidents
Real-world cases where AI systems caused harm, classified by risk domain and entity. Data sourced from 
AIID and classified by 
MIT AI Risk Initiative. CC BY-SA 4.0
538 incidents
GPT-4 Reportedly Posed as Blind Person to Convince Human to Complete CAPTCHA
GPT-4 was reported by its researchers posing as a visually impaired person, contacting a TaskRabbit worker to have them complete the CAPTCHA test on its behalf.
Female Celebrities' Faces Reportedly Shown in Sexually Suggestive Ads for Deepfake App
Sexually suggestive videos featuring faces of female celebrities such as Emma Watson and Scarlett Johansson were reportedly rolled out as ads on social media for an app allowing users to create deepfakes.
TikTok User Videos Impersonated Andrew Tate Using AI Voice, Prompting Ban
A TikTok user was reportedly impersonating Andrew Tate, who was banned on the platform, by posting videos featuring an allegedly AI-generated audio of Tate's voice, which prompted his account ban.
Deepfake Video Targets Paul Vallas on Eve of Chicago Mayoral Election
On the eve of Chicago's mayoral election, a deepfake video impersonating candidate Paul Vallas was posted to Twitter, showing a fake audio of him making inflammatory statements. The video was viewed thousands of times before being taken down. The Vallas campaign condemned the video, calling it a deceptive impersonation.
UK Bank's Voice ID Successfully Bypassed Using AI-Produced Audio
A UK journalist was able to successfully bypass Lloyds Bank's "Voice ID" program to access his bank account using an AI-generated audio of his own voice.
Clarkesworld Magazine Reportedly Closed Down Submissions Due to Massive Increase in Purportedly AI-Generated Stories
Sci-fi magazine Clarkesworld is reported to have temporarily stopped accepting submissions after receiving an overwhelming increase in purportedly LLM-generated submissions.
A Purported Deepfake of Senator Elizabeth Warren Circulates Allegedly Saying Republicans Should Not Vote
In February 2023, a purported deepfake of Senator Elizabeth Warren circulated on social media in which allegedly doctored footage of her from an MSNBC interview had her claiming that she believes Republicans should not vote.
Deepfake Video Featured Fictitious News Anchors Discussing Venezuela's Economy
Video featuring fictitious news anchors was created using Synthesia to allegedly spread disinformation about Venezuela's economy on social media and Venezuelan state-run broadcast.
Purported Deepfake TikTok Video Reportedly Featured Joe Rogan Endorsing Supplement Brand
A purported deepfake video featuring podcast host Joe Rogan reportedly advertising to his listeners about a "libido-boosting" supplement was circulating on TikTok and other platforms before being removed by TikTok along with the account which posted it.
Carmel High School Students Reportedly Posted Racist Deepfake Videos Making New York Principal Appear to Threaten Black Students
At Carmel High School in New York, three students reportedly posted AI-generated deepfake videos on TikTok impersonating George Fischer Middle School principal John Piscitella and a sheriff's-office member making racist slurs and violent threats against Black students. The videos were reported to school officials on February 12, 2023, and parents later criticized the district's communication and safety response.
Synthesized Voices Were Reportedly Used by Torswats to Sell Swatting Calls Targeting Schools and Homes
A Telegram user or channel known as Torswats reportedly offered paid swatting services and uploaded recordings of false emergency calls using synthesized or computer-generated voices. Reported targets included high schools, private residences, streamers, businesses, and police departments; some calls prompted lockdowns, searches, or armed law-enforcement responses. The exact voice-generation tool was not identified.
AI Generated Voices Used to Dox Voice Actors
Twitter users allegedly used ElevenLab's AI voice synthesis system to impersonate and dox voice actors.
Online Scammers Tricked People into Sending Money Using AI Images of Earthquake in Turkey
AI-generated images depicting earthquakes and rescues were posted on social media platforms by scammers who tricked people into sending funds to their crypto wallets disguised as donation links for the 2023 Turkey–Syria earthquake.
Instagram Video Featured Deepfake Audio of US President Making Transphobic Remarks
A deepfaked audio of US President Joe Biden making transphobic remarks played on top of a video showing him giving a speech was released on Instagram and circulated on social media.
Alleged ChatGPT-Generated Book with a Duplicate Title, Fake Author, and Similar Content Surfaces on Amazon Ahead of Real Author's Book Release
The author Chris Cowell had spent more than a year writing his book "Automating DevOps with GitLab CI/CD Pipelines" when, three weeks before its release, another book appeared bearing the exact title by an author (Marie Karpos) for whom no information could be found. The book appeared to have been written by ChatGPT. While the original Washington Post story does not say so, it is possible the name and description were taken from the Amazon preorder page.