AI Incidents
Real-world cases where AI systems caused harm, classified by risk domain and entity. Data sourced from 
AIID and classified by 
MIT AI Risk Initiative. CC BY-SA 4.0
736 incidents
Scammers Allegedly Use Deepfake Technology to Pose as Leonor, Princess of Asturias, in Fraud Scheme
Scammers have allegedly been using deepfake technology and fake social media accounts to reportedly impersonate Leonor, Princess of Asturias, targeting vulnerable individuals in Latin America. Victims were reportedly lured with promises of financial aid, requiring payments for "fees" or "taxes" before receiving funds, only to allegedly be defrauded repeatedly. TikTok accounts with thousands of followers reportedly amplified the scheme using AI to increase the appearance of credibility.
Scammers Allegedly Use Deepfake of Hong Kong Entertainer Andy Lau to Steal NT$2.64 Million from Fan
Scammers allegedly defrauded a woman in New Taipei City of NT$2.64 million (US$81,116) by impersonating Hong Kong entertainer Andy Lau using purported deepfakes. The alleged scam convinced the victim, a long-time fan, through a video call that "Lau" needed funds for a visit to Taiwan. The victim reportedly wired the money, but her family suspected a scam and involved the police. An alleged scammer was arrested after attempting to collect a staged cash payment.
Cody Enterprise Reporter Resigns After Admitting to AI-Generated Fake Quotes
A reporter at the Cody Enterprise used AI to generate fake quotes and stories, including fabricating statements from Wyoming’s governor and other officials. The misuse of AI was uncovered when another journalist noticed robotic phrases and false information in the articles. The reporter resigned, and the newspaper is now implementing policies to prevent future incidents.
AI-Enabled Fraud Schemes Reportedly Increasing Consumer Harm and Challenging Detection
Scammers are reportedly using AI tools such as language models, voice cloning, and synthetic IDs to create more convincing frauds, leading to financial losses and identity theft. Banks have begun deploying AI-driven verification tools to counter these schemes, but experts warn that AI-enabled fraud continues to cause real-world harm and remains difficult to detect.
Senior Minister of Singapore Lee Hsien Loong Allegedly Misrepresented in Two Deepfake Videos on Foreign Relations
Two deepfake videos falsely depicted Senior Minister of Singapore Lee Hsien Loong commenting on US-China relations and the South China Sea. The videos misleadingly attributed views to him and the Singapore government. Posted on TikTok, the videos amassed over 190,000 views before being removed.
Purportedly AI-Generated Papers Are Alleged to Have Manipulated Scopus Rankings in Top Philosophy Journals
Three reportedly fake journals published by Addleton Academic Publishers allegedly manipulated Scopus rankings by extensively cross-citing each other and using AI-generated papers filled with buzzwords. These journals, placed in the top 10 of Scopus's 2023 CiteScore philosophy list, reportedly featured fake authors, affiliations, and grant numbers, in turn allegedly pushing legitimate journals to lower tiers, affecting academic evaluations and awards.
Auto Insurers Allegedly Are Surreptitiously Collecting and Scoring Driver Data
The insurance industry allegedly uses AI and telematics to score drivers based on behaviors tracked by automakers and apps like Life360. Data, often collected without clear consent, may affect insurance rates and raises privacy concerns. Consumers are largely unaware of this surveillance, leading to potential misuse and discrimination based on driving habits or socioeconomic factors.
Turkish Student in Isparta Allegedly Uses AI to Cheat on Exam, Leading to Arrest
A Turkish student in Isparta was reportedly arrested for using ChatGPT to cheat during the 2024 YKS university entrance exam. The student, identified as M.E.E., is alleged to have employed a sophisticated setup involving a router, mobile phone, earphone, and a button-shaped camera to transmit exam questions to ChatGPT and receive answers in real-time.
Teenager Reportedly Makes Deepfake Pornography of 50 Girls at Bacchus Marsh Grammar School in Australia
At Bacchus Marsh Grammar, a school in Victoria state in Australia, an adolescent male reportedly made deepfake pornography of 50 girls, ages 9 to 12. He then allegedly uploaded the pictures to Instagram, and others subsequently shared them on Snapchat.
xAI Allegedly Operates Unpermitted Methane Turbines in Memphis to Power Supercomputer Colossus to Train Grok
The xAI "Colossus" supercomputer facility in South Memphis allegedly runs 33 methane-powered turbines, despite a permit for only 15. The turbines reportedly power AI training for Grok. The facility's massive energy use and alleged unpermitted turbines reportedly produce extreme nitrogen oxide and formaldehyde emissions, adding toxic smog to a predominantly Black neighborhood already burdened by pollution and health risks.
Reported Use of Purportedly AI-Generated Student Accounts in Online College Courses
An adjunct professor at an unspecified community college reportedly suspected that some students in his online art history and art appreciation courses are AI-powered spambots. These "students" allegedly submitted peculiar assignments, such as analyses of non-existent artworks and descriptions of sculptures using painting terminology. Additionally, their engagement with the college portal is reportedly minimal. The professor reportedly believed the spambot students aimed to fraudulently obtain financial aid by remaining enrolled in courses.
Scammers Allegedly Manipulate 2023 Speech of Singapore Senior Minister Lee Hsien Loong to Spread Deepfake Investment Fraud
A new deepfake video falsely showed Prime Minister Lee Hsien Loong endorsing an investment product with guaranteed returns. Scammers synchronized fake audio with real footage from his 2023 National Day speech, making it appear as though he had made the endorsement. Lee called this “extremely worrying” and warned that deepfake scams are becoming more sophisticated. He urged the public to report such scams through the government’s ScamShield Bot.
Disinformation Deepfake Circulates of State Department Spokesman Matthew Miller Suggesting Belgorod Can Be Attacked with U.S. Weapons
A deepfake video of State Department spokesman Matthew Miller falsely suggested Belgorod was a legitimate target for Ukrainian strikes. This disinformation spread on Telegram and Russian media, misleading the public and inciting tensions. U.S. officials condemned the deepfake. This incident is an example of the threat of AI-powered disinformation and hybrid attacks.
Hoodline Accused of Misleadingly Attributing AI-Generated Articles to Human Authors
In 2023, the news site Hoodline is reported to have begun publishing AI-generated articles with fake bylines, headshots, and biographies, allegedly misleading readers into believing they were authored by real journalists. This practice diminishes public trust and exemplifies the potential dangers of AI in journalism. Despite a disclaimer, the use of AI was not transparent.
Covert AI Influence Operations Linked to Russia, China, Iran, and Israel, OpenAI Reports
In a report released by OpenAI, the company described how its generative AI tools were misused by state actors and private companies in Russia, China, Iran, and Israel to conduct covert influence campaigns aimed at manipulating public opinion and geopolitical narratives.