AI Incidents
Real-world cases where AI systems caused harm, classified by risk domain and entity. Data sourced from
AIID and classified by MIT AI Risk Initiative. CC BY-SA 4.0
526 incidents
Proliferation of AI-Generated News Websites and Content Farms Across Multiple Languages Degrading Information Integrity
Scores of AI-generated news websites and content farms are producing low-quality, clickbait content in a variety of languages. They are reportedly spreading false information and degrading the quality of information available online. These sites often lack human oversight, feature repetitive language, and sometimes fabricate information, posing a threat to the credibility of online news sources.
Purported Republican AI Ad Reportedly Depicts Dystopian Future After Biden Reelection Announcement
After Joe Biden announced his 2024 reelection bid, the Republican National Committee reportedly released an attack ad that included purportedly AI-generated images portraying a dystopian future for the United States. Even with a brief disclaimer, the ad's fabricated scenes purportedly introduced false information into the political environment and created a misleading visual frame around an active electoral process.
Purported AI-Generated Audio Disinformation Reportedly Attributed to U.S. Ambassador John Godfrey Circulates in Sudan
In April 2023, a reportedly fake audio message impersonating U.S. Ambassador to Sudan John Godfrey circulated on Sudanese social media. Reportedly produced using AI voice-cloning tools, the message portrayed the ambassador outlining strategies to impose secularism through U.S. support. Researchers attribute the clip to Islamist-linked networks seeking to undermine Western and civilian influence during the ongoing civil conflict. The message was quickly identified as inauthentic.
Quebec Man Sentenced for Having Used Deepfake Technology to Create Synthetic Child Pornography
A Quebec man was sentenced to over three years in prison for using AI deepfake technology to produce synthetic child pornography. He created videos by superimposing children's faces onto other bodies, adding to the challenge of policing digital sexual exploitation. This case marks a disturbing use of AI in criminal activities, raising concerns about digital safety and the vulnerability of children's images online.
FBI Reported Surge of Extortion Cases of AI Media Featuring Sexual Explicit Activities
The FBI reported an increase in sextortion cases featuring the use of fake, including AI-generated, images or videos created from content posted on their social media sites or web postings, provided to the malicious actor upon request, or captured during video chats.
South Korean man used AI to create sexual images of children
A South Korean man used AI technology to generate 360 images of a sexual nature depicting children in April of 2023. The police confiscated the images and the courts sentenced the man to two and a half years in prison. The case marked the first of its nature in the South Korean court system.
Scammers Deepfaked Videos of Victims' Loved Ones Asking for Funds over Facebook in Vietnam
In Vietnam, to convince victims of their disguises when prompted, scammers deepfaked audios and videos of victims' friends and families asking them over Facebook to send over thousands of dollars.
ChatGPT Reportedly Implicated in Samsung Data Leak of Source Code and Meeting Notes
Samsung engineers are reported to have inadvertently leaked sensitive company data sometime in March 2023, including source code and internal meeting notes, by using ChatGPT to assist with tasks. ChatGPT allegedly retained the inputted data, leading to a purported breach of confidentiality.
TikTok User Videos Impersonated Andrew Tate Using AI Voice, Prompting Ban
A TikTok user was reportedly impersonating Andrew Tate, who was banned on the platform, by posting videos featuring an allegedly AI-generated audio of Tate's voice, which prompted his account ban.
Meta and OpenAI Accused of Using LibGen’s Pirated Books to Train AI Models
Court records reveal that Meta employees allegedly discussed pirating books to train LLaMA 3, citing cost and speed concerns with licensing. Internal messages suggest Meta accessed LibGen, a repository of over 7.5 million pirated books, with apparent approval from Mark Zuckerberg. Employees allegedly took steps to obscure the dataset’s origins. OpenAI has also been implicated in using LibGen.
Clarkesworld Magazine Reportedly Closed Down Submissions Due to Massive Increase in Purportedly AI-Generated Stories
Sci-fi magazine Clarkesworld is reported to have temporarily stopped accepting submissions after receiving an overwhelming increase in purportedly LLM-generated submissions.
A Purported Deepfake of Senator Elizabeth Warren Circulates Allegedly Saying Republicans Should Not Vote
In February 2023, a purported deepfake of Senator Elizabeth Warren circulated on social media in which allegedly doctored footage of her from an MSNBC interview had her claiming that she believes Republicans should not vote.
Vanderbilt Peabody Office's Purportedly ChatGPT-Drafted Message About Michigan State Shooting Reportedly Drew Student Backlash
On February 16, 2023, Vanderbilt University's Peabody College Office of Equity, Diversity and Inclusion reportedly sent students a message about the Michigan State University shooting that disclosed it had been drafted or paraphrased using ChatGPT. Students reportedly criticized the message as impersonal and disrespectful in a moment of grief. Peabody later apologized for "poor judgment," and two EDI deans temporarily stepped back during a review.
Deepfake Video Featured Fictitious News Anchors Discussing Venezuela's Economy
Video featuring fictitious news anchors was created using Synthesia to allegedly spread disinformation about Venezuela's economy on social media and Venezuelan state-run broadcast.
Carmel High School Students Reportedly Posted Racist Deepfake Videos Making New York Principal Appear to Threaten Black Students
At Carmel High School in New York, three students reportedly posted AI-generated deepfake videos on TikTok impersonating George Fischer Middle School principal John Piscitella and a sheriff's-office member making racist slurs and violent threats against Black students. The videos were reported to school officials on February 12, 2023, and parents later criticized the district's communication and safety response.