AI Incidents
Real-world cases where AI systems caused harm, classified by risk domain and entity. Data sourced from 
AIID and classified by 
MIT AI Risk Initiative. CC BY-SA 4.0
566 incidents
Purported AI-Generated Audio Disinformation Reportedly Attributed to U.S. Ambassador John Godfrey Circulates in Sudan
In April 2023, a reportedly fake audio message impersonating U.S. Ambassador to Sudan John Godfrey circulated on Sudanese social media. Reportedly produced using AI voice-cloning tools, the message portrayed the ambassador outlining strategies to impose secularism through U.S. support. Researchers attribute the clip to Islamist-linked networks seeking to undermine Western and civilian influence during the ongoing civil conflict. The message was quickly identified as inauthentic.
Chinese Businessman Reportedly Defrauded of 4.3 Million Yuan by AI-Generated Deepfake Impersonating Friend
A scammer in China used AI-generated deepfake technology to impersonate a businessman’s trusted friend in a video call, convincing him to transfer 4.3 million yuan ($612,000). The fraudster mimicked the friend’s face and voice, claiming another associate needed funds for a business transaction. Without verifying the transfer, the victim sent the money. He later realized the deception and contacted police, who managed to recover 3.4 million yuan.
Quebec Man Sentenced for Having Used Deepfake Technology to Create Synthetic Child Pornography
A Quebec man was sentenced to over three years in prison for using AI deepfake technology to produce synthetic child pornography. He created videos by superimposing children's faces onto other bodies, adding to the challenge of policing digital sexual exploitation. This case marks a disturbing use of AI in criminal activities, raising concerns about digital safety and the vulnerability of children's images online.
FBI Reported Surge of Extortion Cases of AI Media Featuring Sexual Explicit Activities
The FBI reported an increase in sextortion cases featuring the use of fake, including AI-generated, images or videos created from content posted on their social media sites or web postings, provided to the malicious actor upon request, or captured during video chats.
South Korean man used AI to create sexual images of children
A South Korean man used AI technology to generate 360 images of a sexual nature depicting children in April of 2023. The police confiscated the images and the courts sentenced the man to two and a half years in prison. The case marked the first of its nature in the South Korean court system.
Scammers Deepfaked Videos of Victims' Loved Ones Asking for Funds over Facebook in Vietnam
In Vietnam, to convince victims of their disguises when prompted, scammers deepfaked audios and videos of victims' friends and families asking them over Facebook to send over thousands of dollars.
GPT-4 Reportedly Posed as Blind Person to Convince Human to Complete CAPTCHA
GPT-4 was reported by its researchers posing as a visually impaired person, contacting a TaskRabbit worker to have them complete the CAPTCHA test on its behalf.
Female Celebrities' Faces Reportedly Shown in Sexually Suggestive Ads for Deepfake App
Sexually suggestive videos featuring faces of female celebrities such as Emma Watson and Scarlett Johansson were reportedly rolled out as ads on social media for an app allowing users to create deepfakes.
TikTok User Videos Impersonated Andrew Tate Using AI Voice, Prompting Ban
A TikTok user was reportedly impersonating Andrew Tate, who was banned on the platform, by posting videos featuring an allegedly AI-generated audio of Tate's voice, which prompted his account ban.
Deepfake Video Targets Paul Vallas on Eve of Chicago Mayoral Election
On the eve of Chicago's mayoral election, a deepfake video impersonating candidate Paul Vallas was posted to Twitter, showing a fake audio of him making inflammatory statements. The video was viewed thousands of times before being taken down. The Vallas campaign condemned the video, calling it a deceptive impersonation.
UK Bank's Voice ID Successfully Bypassed Using AI-Produced Audio
A UK journalist was able to successfully bypass Lloyds Bank's "Voice ID" program to access his bank account using an AI-generated audio of his own voice.
Clarkesworld Magazine Reportedly Closed Down Submissions Due to Massive Increase in Purportedly AI-Generated Stories
Sci-fi magazine Clarkesworld is reported to have temporarily stopped accepting submissions after receiving an overwhelming increase in purportedly LLM-generated submissions.
A Purported Deepfake of Senator Elizabeth Warren Circulates Allegedly Saying Republicans Should Not Vote
In February 2023, a purported deepfake of Senator Elizabeth Warren circulated on social media in which allegedly doctored footage of her from an MSNBC interview had her claiming that she believes Republicans should not vote.
Deepfake Video Featured Fictitious News Anchors Discussing Venezuela's Economy
Video featuring fictitious news anchors was created using Synthesia to allegedly spread disinformation about Venezuela's economy on social media and Venezuelan state-run broadcast.
Purported Deepfake TikTok Video Reportedly Featured Joe Rogan Endorsing Supplement Brand
A purported deepfake video featuring podcast host Joe Rogan reportedly advertising to his listeners about a "libido-boosting" supplement was circulating on TikTok and other platforms before being removed by TikTok along with the account which posted it.