AI Incidents
Real-world cases where AI systems caused harm, classified by risk domain and entity. Data sourced from
AIID and classified by MIT AI Risk Initiative. CC BY-SA 4.0
464 incidents
Ron DeSantis's Presidential Campaign Released Twitter Video Containing AI Images of Donald Trump Hugging Anthony Fauci
Ron DeSantis’s presidential campaign shared a video on Twitter featuring some AI-generated images of Donald Trump hugging former White House coronavirus advisor Anthony Fauci, allegedly as a smear campaign. This incident is possibly the first time a major U.S. presidential campaign deployed deepfakes with the intention of misleading the electorate.
AI-Generated Voices Amplify Conspiracy Theories on TikTok
NewsGuard has identified 17 TikTok accounts that have been using AI-generated voices to advance and amplify conspiracy theories and false claims beginning in June 2023. By September 25, 2023, these accounts had amassed over 336 million views and over 14.5 million likes. Videos include baseless claims involving public figures such as Barack Obama, Oprah Winfrey, and Jamie Foxx.
Donald Trump's Presidential Campaign Released Deepfakes Attacking Ron DeSantis
Former President Donald Trump released two AI-generated videos using deepfaked voices to mock Florida Governor Ron DeSantis. The first video, posted on platforms like Rumble and Instagram, depicted a chaotic and offensive fake Twitter Spaces event featuring deepfaked voices of Elon Musk, George Soros, Klaus Schwab, Dick Cheney, Adolf Hitler, and a generated voice of Satan. The second video showed a rocket with "Ron 2024" written beside it falling and exploding before liftoff.
FTC Targets Edmodo for Unlawful Use of Children’s Data and Delegating Compliance to Schools
Edmodo, an education technology provider, violated the Children's Online Privacy Protection Act Rule (COPPA Rule) by collecting and using children's personal data for advertising purposes without parental consent, according to the FTC. The company outsourced its compliance responsibilities to schools, thereby making them "solely" responsible for COPPA compliance without adequate disclosure. Edmodo is facing a proposed order prohibiting such practices, marking a precedent in the ed tech industry.
Iranian Hacker Group Cotton Sandstorm Reportedly Integrating AI into Cyber Influence Operations
The Iranian state-sponsored group Cotton Sandstorm, linked to the IRGC, has integrated generative AI into cyber influence operations. In December 2023, it launched Operation “For Humanity," using AI-crafted messaging to hijack a U.S.-based IPTV streaming service with propaganda about the Israel-Hamas conflict. The group also engages in election-related reconnaissance, which suggests they used AI-enhanced influence efforts ahead of the 2024 U.S. election.
Proliferation of AI-Generated News Websites and Content Farms Across Multiple Languages Degrading Information Integrity
Scores of AI-generated news websites and content farms are producing low-quality, clickbait content in a variety of languages. They are reportedly spreading false information and degrading the quality of information available online. These sites often lack human oversight, feature repetitive language, and sometimes fabricate information, posing a threat to the credibility of online news sources.
Purported Republican AI Ad Reportedly Depicts Dystopian Future After Biden Reelection Announcement
After Joe Biden announced his 2024 reelection bid, the Republican National Committee reportedly released an attack ad that included purportedly AI-generated images portraying a dystopian future for the United States. Even with a brief disclaimer, the ad's fabricated scenes purportedly introduced false information into the political environment and created a misleading visual frame around an active electoral process.
Purported AI-Generated Audio Disinformation Reportedly Attributed to U.S. Ambassador John Godfrey Circulates in Sudan
In April 2023, a reportedly fake audio message impersonating U.S. Ambassador to Sudan John Godfrey circulated on Sudanese social media. Reportedly produced using AI voice-cloning tools, the message portrayed the ambassador outlining strategies to impose secularism through U.S. support. Researchers attribute the clip to Islamist-linked networks seeking to undermine Western and civilian influence during the ongoing civil conflict. The message was quickly identified as inauthentic.
Quebec Man Sentenced for Having Used Deepfake Technology to Create Synthetic Child Pornography
A Quebec man was sentenced to over three years in prison for using AI deepfake technology to produce synthetic child pornography. He created videos by superimposing children's faces onto other bodies, adding to the challenge of policing digital sexual exploitation. This case marks a disturbing use of AI in criminal activities, raising concerns about digital safety and the vulnerability of children's images online.
FBI Reported Surge of Extortion Cases of AI Media Featuring Sexual Explicit Activities
The FBI reported an increase in sextortion cases featuring the use of fake, including AI-generated, images or videos created from content posted on their social media sites or web postings, provided to the malicious actor upon request, or captured during video chats.
South Korean man used AI to create sexual images of children
A South Korean man used AI technology to generate 360 images of a sexual nature depicting children in April of 2023. The police confiscated the images and the courts sentenced the man to two and a half years in prison. The case marked the first of its nature in the South Korean court system.
Scammers Deepfaked Videos of Victims' Loved Ones Asking for Funds over Facebook in Vietnam
In Vietnam, to convince victims of their disguises when prompted, scammers deepfaked audios and videos of victims' friends and families asking them over Facebook to send over thousands of dollars.
TikTok User Videos Impersonated Andrew Tate Using AI Voice, Prompting Ban
A TikTok user was reportedly impersonating Andrew Tate, who was banned on the platform, by posting videos featuring an allegedly AI-generated audio of Tate's voice, which prompted his account ban.
Meta and OpenAI Accused of Using LibGen’s Pirated Books to Train AI Models
Court records reveal that Meta employees allegedly discussed pirating books to train LLaMA 3, citing cost and speed concerns with licensing. Internal messages suggest Meta accessed LibGen, a repository of over 7.5 million pirated books, with apparent approval from Mark Zuckerberg. Employees allegedly took steps to obscure the dataset’s origins. OpenAI has also been implicated in using LibGen.
Clarkesworld Magazine Reportedly Closed Down Submissions Due to Massive Increase in Purportedly AI-Generated Stories
Sci-fi magazine Clarkesworld is reported to have temporarily stopped accepting submissions after receiving an overwhelming increase in purportedly LLM-generated submissions.
Risk Taxonomy
Caused By
Year Trend
* Oct 2026, ~320 projected full year
AIID · MIT AIRI · CC BY-SA 4.0