AI Incidents
Real-world cases where AI systems caused harm, classified by risk domain and entity. Data sourced from 
AIID and classified by 
MIT AI Risk Initiative. CC BY-SA 4.0
368 incidents
HTML/Nomani Deepfake Phishing Campaigns Allegedly Use AI-Generated Content to Defraud Social Media Users
AI-generated deepfakes were reportedly used in the "HTML/Nomani" phishing campaign to mimic legitimate platforms like booking services and lured victims into investment scams. These scams allegedly leveraged realistic fake content to deceive users on social media for the purposes of financial fraud. This campaign was part of the rising misuse of AI in cybercrime during the second half of 2024.
Matryoshka Campaign Allegedly Uses Deepfakes to Impersonate Academics for Pro-Russian Propaganda
The Matryoshka disinformation campaign allegedly used AI to impersonate academics, reportedly spreading claims supporting Russia and urging Ukraine's surrender. These videos are said to have misrepresented scholars’ views in order to amplify pro-Russian propaganda. The campaign reportedly exploited global social media platforms to allegedly mislead viewers and undermine trust in credible academic voices while fueling misinformation about the Ukraine conflict.
Scammers Reportedly Using Deepfakes of Health Experts and Public Figures in Australia to Sell Health Supplements and Give Harmful Advice
Scammers are reportedly harnessing AI-generated deepfakes of health experts and public figures in Australia in order to sell health supplements and give harmful health advice. Among the reported cases, deepfake videos are alleged to have falsely depicted Jonathan Shaw and Karl Stefanovic endorsing "Glyco Balance" for diabetes management, while Karl Kruszelnicki reportedly was falsely shown promoting blood pressure pills.
Meeten Malware Campaign Reportedly Undermines Web3 Security Using AI-Legitimized Branding
Threat actors, using aliases such as "Meeten," "Meetio," and "Clusee," reportedly deployed AI-generated content to create fake company websites, blogs, and social media profiles, impersonating legitimate businesses in order to trick Web3 professionals and cryptocurrency users into downloading Realst malware. The malware allegedly targets macOS and Windows platforms, steals credentials, browser data, and cryptocurrency wallet information, exfiltrating sensitive data to remote servers.
Purported Deepfake Nude Images of Students Circulated Without Consent at Valencia Educational Institute
Purported deepfake nude images of female students were circulated without consent at an educational institute in Valencia, Spain. At least 16 minors reported that original photographs had been digitally manipulated so they appeared completely naked, with some images shared via social media accounts created in victims' names. The alleged creation and distribution of the images is being examined under Spanish laws related to the protection of minors.
Ohio Man Pleaded Guilty after Prosecutors Alleged He Used AI to Create and Distribute Nonconsensual Intimate-Image Forgeries Including CSAM in Harassment Campaign
An Ohio man, James Strahler II, pleaded guilty in federal court after prosecutors alleged that, from late 2024 into mid-2025, he used AI tools to create and distribute nonconsensual intimate-image forgeries as part of a broader harassment campaign targeting at least six adult women. Authorities said the conduct also involved additional CSAM material. The Department of Justice said it believes this was the first U.S. conviction under the Take It Down Act.
Florida Woman Reportedly Jailed After Ex-Boyfriend Allegedly Submitted AI-Fabricated Text Screenshot as Bond-Violation Evidence
A Florida nurse, Melissa Sims, was reportedly jailed for two days for purportedly violating a bond/no-contact order. Reportedly, her ex-boyfriend produced purportedly AI-generated text messages or a "text receipt" attributed to her.
Yahoo Boys and Scammers from Morocco Allegedly Target U.S. Widows and Vulnerable Individuals with 'Artificial Patriot' Scams
Yahoo Boys (from Nigeria and Ghana) and scammers from Morocco are reportedly targeting U.S. widows and vulnerable individuals using AI-generated images and fake military profiles in "Artificial Patriot" scams. They have allegedly impersonated military officials such as General Matthew W. McFarlane to gain trust, sharing fabricated backstories and emotional appeals. Once trust is established, they request money through untraceable methods.
Generative AI Plagiarism Incident at Hingham High School Reportedly Tied to Inaccurate Citation Outputs from Grammarly AI
In December 2023, two Hingham High School students ("RNH" and unnamed) reportedly used Grammarly to create a script for an AP U.S. History project. The AI-generated text included fabricated citations to nonexistent books, which the student copied and pasted without verification or acknowledgment of AI use. This violated the school's academic integrity policies, leading to disciplinary action. RNH's parents later sued the school district, but a federal court ruled in favor of the school.
Corinth School District Educator in Mississippi Allegedly Used AI to Generate CSAM of Students
An educator in the Corinth School District of Mississippi, Wilson Jones, was arrested for allegedly using AI to generate child sexual abuse material (CSAM) of students. A complaint was filed with the police on January 29th, 2025, and a search warrant was executed on March 3rd, 2025. The FBI allege that the crime was committed sometime on or before November 19th, 2024.
Alleged AI-Generated Scam Uses Bank of Cyprus Branding to Solicit Investments
An alleged fraudulent online platform presented as the "Bank of Cyprus Trading AI Platform" was promoted using reportedly fabricated media, including a video that appeared to depict the Bank's CEO endorsing the service. The video reportedly used misleading branding, including the BBC logo, and promised unrealistic investment returns. The Bank of Cyprus publicly denied any affiliation and warned customers about the use of AI-generated content in the scam.
Students of Richland School District in Cambria County, Pennsylvania Allegedly Used AI to Generate Obscene Images of Other Students
The Richland School District (Cambria County, Pennsylvania) released a statement on November 19, 2024 announcing an investigation into "some secondary students" who are alleged to have used AI to "create and electronically distribute obscene images of Richland students." The school administrators became aware of the incident on November 14, 2024.
Purportedly AI-Generated Video Allegedly Depicts Martin Luther King Jr. Supporting Donald Trump
A purported deepfake video allegedly depicting Martin Luther King Jr. endorsing Donald Trump circulated on X, where it was reported to have been viewed over 10 million times. The video, reportedly created by pro-Trump accounts, was reportedly condemned by King's daughter, Bernice King, who called it "vile" and demanded its removal.
Reportedly Fake CNN Broadcast Allegedly Used to Spread False Texas Election Results
A reportedly fabricated CNN broadcast graphic showing early Texas election results for the 2024 U.S. presidential race circulated on social media on November 2, 2024. The purportedly manipulated image claimed that Vice President Kamala Harris led over Donald Trump before polls opened, allegedly fueling misinformation about election integrity. CNN is reported to have confirmed the image was inauthentic, and AFP debunked the claims.
Deepfake Videos of Barbara O’Neill Allegedly Used in Health Scam Targeting Social Media Users
Deepfake videos of Barbara O’Neill, an Australian alternative health advocate banned from giving medical advice, have allegedly been used in fraudulent social media ads promoting false health cures. They include treatments for prostate issues and erectile dysfunction. These manipulated videos have been widely circulated across African countries. The scam directs users to deceptive websites, potentially for phishing or financial fraud. O’Neill has denied involvement.