AI Incidents
Real-world cases where AI systems caused harm, classified by risk domain and entity. Data sourced from 
AIID and classified by 
MIT AI Risk Initiative. CC BY-SA 4.0
736 incidents
Iranian Hacker Group Cotton Sandstorm Reportedly Integrating AI into Cyber Influence Operations
The Iranian state-sponsored group Cotton Sandstorm, linked to the IRGC, has integrated generative AI into cyber influence operations. In December 2023, it launched Operation “For Humanity," using AI-crafted messaging to hijack a U.S.-based IPTV streaming service with propaganda about the Israel-Hamas conflict. The group also engages in election-related reconnaissance, which suggests they used AI-enhanced influence efforts ahead of the 2024 U.S. election.
Proliferation of AI-Generated News Websites and Content Farms Across Multiple Languages Degrading Information Integrity
Scores of AI-generated news websites and content farms are producing low-quality, clickbait content in a variety of languages. They are reportedly spreading false information and degrading the quality of information available online. These sites often lack human oversight, feature repetitive language, and sometimes fabricate information, posing a threat to the credibility of online news sources.
Purported Republican AI Ad Reportedly Depicts Dystopian Future After Biden Reelection Announcement
After Joe Biden announced his 2024 reelection bid, the Republican National Committee reportedly released an attack ad that included purportedly AI-generated images portraying a dystopian future for the United States. Even with a brief disclaimer, the ad's fabricated scenes purportedly introduced false information into the political environment and created a misleading visual frame around an active electoral process.
Novel Deepfake Song Pulled from Music Streaming Services After Allegedly Violating Artist's Rights
The deepfake performance of "Heart On My Sleeve" created to mimic the voice and musical styles of Drake and The Weeknd is no longer available on several streaming services after their record label served copyright takedown notices to the platforms.
Purported AI-Generated Audio Disinformation Reportedly Attributed to U.S. Ambassador John Godfrey Circulates in Sudan
In April 2023, a reportedly fake audio message impersonating U.S. Ambassador to Sudan John Godfrey circulated on Sudanese social media. Reportedly produced using AI voice-cloning tools, the message portrayed the ambassador outlining strategies to impose secularism through U.S. support. Researchers attribute the clip to Islamist-linked networks seeking to undermine Western and civilian influence during the ongoing civil conflict. The message was quickly identified as inauthentic.
Chinese Businessman Reportedly Defrauded of 4.3 Million Yuan by AI-Generated Deepfake Impersonating Friend
A scammer in China used AI-generated deepfake technology to impersonate a businessman’s trusted friend in a video call, convincing him to transfer 4.3 million yuan ($612,000). The fraudster mimicked the friend’s face and voice, claiming another associate needed funds for a business transaction. Without verifying the transfer, the victim sent the money. He later realized the deception and contacted police, who managed to recover 3.4 million yuan.
Quebec Man Sentenced for Having Used Deepfake Technology to Create Synthetic Child Pornography
A Quebec man was sentenced to over three years in prison for using AI deepfake technology to produce synthetic child pornography. He created videos by superimposing children's faces onto other bodies, adding to the challenge of policing digital sexual exploitation. This case marks a disturbing use of AI in criminal activities, raising concerns about digital safety and the vulnerability of children's images online.
FBI Reported Surge of Extortion Cases of AI Media Featuring Sexual Explicit Activities
The FBI reported an increase in sextortion cases featuring the use of fake, including AI-generated, images or videos created from content posted on their social media sites or web postings, provided to the malicious actor upon request, or captured during video chats.
South Korean man used AI to create sexual images of children
A South Korean man used AI technology to generate 360 images of a sexual nature depicting children in April of 2023. The police confiscated the images and the courts sentenced the man to two and a half years in prison. The case marked the first of its nature in the South Korean court system.
Viral Image of Pope Francis in a Puffer Jacket Revealed to Be AI-Generated
A viral image of Pope Francis wearing a white puffer jacket was a deepfake produced by the photorealistic-image-generator Midjourney.
Scammers Deepfaked Videos of Victims' Loved Ones Asking for Funds over Facebook in Vietnam
In Vietnam, to convince victims of their disguises when prompted, scammers deepfaked audios and videos of victims' friends and families asking them over Facebook to send over thousands of dollars.
GPT-4 Reportedly Posed as Blind Person to Convince Human to Complete CAPTCHA
GPT-4 was reported by its researchers posing as a visually impaired person, contacting a TaskRabbit worker to have them complete the CAPTCHA test on its behalf.
Female Celebrities' Faces Reportedly Shown in Sexually Suggestive Ads for Deepfake App
Sexually suggestive videos featuring faces of female celebrities such as Emma Watson and Scarlett Johansson were reportedly rolled out as ads on social media for an app allowing users to create deepfakes.
TikTok User Videos Impersonated Andrew Tate Using AI Voice, Prompting Ban
A TikTok user was reportedly impersonating Andrew Tate, who was banned on the platform, by posting videos featuring an allegedly AI-generated audio of Tate's voice, which prompted his account ban.
UnitedHealth Accused of Deploying Allegedly Flawed AI to Deny Medical Coverage
UnitedHealthcare allegedly used a faulty AI algorithm with a 90% error rate to override doctors' recommendations and deny health coverage. This AI, developed by NaviHealth, reportedly led to premature discharge from care facilities and substantial out-of-pocket expenses for patients, according to a lawsuit filed in the District Court for Minnesota.