AI Incidents
Real-world cases where AI systems caused harm, classified by risk domain and entity. Data sourced from
AIID and classified by MIT AI Risk Initiative. CC BY-SA 4.0
538 incidents
Meta's Automated Ad and Targeting Systems Reportedly Enabled Large-Scale Fraud Revenue
Internal Meta documents reviewed by Reuters reportedly show that the company's automated ad and targeting systems generated major revenue from fraudulent ads and exposed users to billions of scam impressions daily. Enforcement was limited by internal revenue guardrails. In one example, a Royal Canadian Air Force recruiter's account was hacked and used to run a crypto scam that defrauded several colleagues after repeated reports allegedly went unanswered.
'Citizens Against Mamdani' Accounts Reportedly Posted AI-Generated Videos of Fictional New Yorkers to Simulate Political Opposition
In New York, linked "Citizens Against Mamdani" accounts reportedly posted AI-generated videos of fictional constituents criticizing then-mayor-elect Zohran Mamdani across Instagram, TikTok, and X. Some videos reportedly displayed a visible Sora watermark, and forensic reviewers reportedly assessed at least one clip as highly likely to be a deepfake. The campaign reportedly appeared to simulate grassroots opposition and drew substantial engagement.
Balázs Orbán Allegedly Published Purported Deepfake of Péter Magyar Claiming He Would Cut Pensions
In Hungary, opposition leader Péter Magyar alleged that Viktor Orbán aide Balázs Orbán published an unlabeled deepfake video on Facebook reportedly depicting Magyar as saying he would cut and tax pensions ahead of the 2026 parliamentary election. Magyar reportedly said he would file a criminal complaint and described the video as defamatory.
Alleged Fabricated News Sites and Deepfakes Impersonated Maltese Ministers, Financial Experts, and Media to Promote NethertoxAGENT Fraud
Purportedly AI-generated deepfake videos and fabricated news pages impersonating Maltese ministers, journalists, financial experts, and major media outlets reportedly promoted the fraudulent "NethertoxAGENT" investment platform. The scam used synthetic interviews, cloned branding, and falsified testimonials to mislead social media users, reportedly inducing financial losses and prompting law enforcement concern in Malta.
Purportedly AI-Generated Deepfake Investment Ads Defrauded 5,000 Swedish Investors of 500 Million SEK
At least 5,000 Swedish investors were reportedly defrauded of around 500 million SEK (~$52.5 million USD) in 2025 through purportedly AI-generated deepfake investment ads circulated on Meta platforms. Fraudsters allegedly used fabricated videos and profiles of well-known finance figures such as journalist Gabriel Mellqvist and investor Günter Mårder to promote false stock tips in pump-and-dump schemes.
Purported Deepfake Video Impersonating Elton John Reportedly Induced Northeast Ohio Man to Authorize $20,000 in Scam Charges
A Northeast Ohio man ("Ray," pseudonym) was allegedly lured by a social-media deepfake video impersonating Elton John into a "push button" scam promising easy income from an online store. Ray reportedly said he was directed by purported "representatives" to open accounts and credit cards, after which charges accumulated to about $20,000. He later reported one card credited $9,400.
Purported Deepfake Mimicking RTÉ Broadcast Falsely Announced Irish Presidential Candidate Catherine Connolly's Withdrawal
A purported deepfake video circulated online that is alleged to have falsely depicted Irish presidential candidate Catherine Connolly announcing her withdrawal from the race. The clip reportedly mimicked an RTÉ news broadcast and spread across social media before being reported to the Electoral Commission. Connolly reportedly condemned the video as a malicious attempt to mislead voters and undermine democratic trust.
Virginia Candidate John Reid Reportedly Used AI-Generated Deepfake of Opponent Ghazala Hashmi in Simulated Political Debate
Republican Virginia lieutenant governor candidate John Reid reportedly held a 40-minute mock debate against a purportedly AI-generated version of Democratic opponent Sen. Ghazala Hashmi. The bot reportedly mimicked her voice and synthesized responses trained on her public statements. Hashmi's campaign denounced the nonconsensual likeness as a "shoddy gimmick."
Purported Deepfake Video Allegedly Shows Conservative MP George Freeman Leaving Party for Reform UK
A purported AI-generated deepfake video circulated online falsely depicting UK Conservative MP George Freeman announcing his defection to the Reform UK party. The fabricated clip, which mimicked Freeman’s likeness and voice without his knowledge or consent, included statements critical of the Conservatives and was widely shared on social media. Freeman denounced the video as disinformation, reported it to police, and warned that such synthetic media pose serious risks to democratic processes.
Purported AI-Generated Deepfake Video Reportedly Depicts Senator Chuck Schumer Endorsing Government Shutdown in NRSC Campaign Ad
The National Republican Senatorial Committee (NRSC) allegedly released a 30-second campaign ad featuring a purported deepfake video of Senator Chuck Schumer repeatedly saying, "Every day gets better for us," implying enthusiasm for a government shutdown. While the video reportedly was marked as AI-generated, it was widely circulated on social media and drew criticism from journalists and researchers, who warned it could mislead voters and erode trust in authentic political communication.
Purported AI-Generated Video Reportedly Used in RM5,800 (~$1,400) Sextortion Attempt Targeting Malaysian Minor via Telegram
A Malaysian family reported that scammers used purported AI-generated explicit video content to target their teenage son in a sextortion attempt. The perpetrators allegedly contacted the boy via Telegram, sending manipulated footage that depicted him in compromising situations and demanding RM5,800 (~$1,400) to prevent its release. The family alerted authorities and warned others about the growing use of generative AI in targeting minors.
Purported AI-Generated Explicit Deepfakes of Sydney High School Students Reportedly Circulated Online
New South Wales police in Australia launched an investigation after parents reported that purported AI-generated sexually explicit images of female students from a Sydney high school had been created and circulated online. The reported manipulated images, produced without consent using deepfake tools, prompted school involvement and a criminal probe under new state laws banning such content.
Multiple Purported AI-Assisted Cheating Incidents Reported Across South Korea's SKY Universities During October 2025 Midterms
Reports from South Korea's SKY universities indicate multiple AI-assisted cheating incidents during the October 2025 midterms. At Yonsei, dozens reportedly used ChatGPT and other tools despite bans in an Oct. 15 online exam. Korea University and Seoul National reportedly found students using AI or sharing answers via group chats, prompting punitive sanctions across the institutions.
Purported Deepfake Explicit Images of Middle School Students Allegedly Created and Circulated Using Mobile App in Goffstown, New Hampshire
In Goffstown, New Hampshire, unnamed eighth-grade boys at Mountain View Middle School allegedly used an AI-enabled app to create and circulate sexualized deepfake images and videos depicting female classmates.
ChatGPT-Generated Image of Nonexistent 'Homeless Man' Was Used in False St. Petersburg, Florida Burglary and Sexual Battery Reports
A St. Petersburg, Florida woman, Brooke Schinault, used a ChatGPT-generated image of a nonexistent man while falsely reporting that he broke into her home and sexually battered her. Police said the image resembled a viral "AI homeless man" prank and was found in a deleted folder dated before the alleged attack. The report prompted officers, rescue personnel, a detective, and forensic DNA collection. She later pleaded no contest and was adjudged guilty of misdemeanor false reporting.