AI Incidents
Real-world cases where AI systems caused harm, classified by risk domain and entity. Data sourced from 
AIID and classified by 
MIT AI Risk Initiative. CC BY-SA 4.0
736 incidents
Alleged Use of AI to Create Sexualized Deepfake Images of Middle School Students Under Investigation in Bucks County, Pennsylvania
Authorities in Bucks County, Pennsylvania reported that a middle school student allegedly used AI-enabled tools to create sexualized deepfake images depicting classmates. The incident, which reportedly occurred in March 2025, involved images generated without consent and is under investigation by local police and the district attorney's office. The alleged conduct may fall under a new Pennsylvania law addressing non-consensual AI-generated sexual imagery, particularly involving minors.
Alleged AI-Generated IRS Scam Websites Used to Defraud U.S. Taxpayers
Scammers have allegedly been using AI-generated imposter websites and phishing emails to impersonate the IRS. They have reportedly been tricking taxpayers into providing personal and financial information. There has been a reported surge in tax-related AI scams leading up to Tax Day 2025, with fraudulent domains mimicking IRS services, along with fake websites, emails, and text messages. The IRS has warned taxpayers to verify official sites and avoid unsolicited links.
AI-Generated Voice Cloning of Trump Falsely Proposes Renaming the District of Columbia to the District of America
A viral audio clip circulating on TikTok, Facebook, X, and other platforms falsely portrayed Donald Trump saying he would rename Washington, D.C. as the "District of America." The voice was confirmed to be AI-generated by digital forensics experts. It was initially posted by a now-deleted TikTok account. The clip is reported to have spread rapidly across political lines before it was debunked.
Docomo Pacific CEO Reports Mother Targeted by Purported AI-Enabled Scam in Guam
Docomo Pacific's CEO, Christine Baleto, disclosed that her elderly mother was targeted by an alleged AI-enabled scam call on Guam. The scammer reportedly posed as a federal agent and used personal details and intimidation, demanding sensitive information under false pretenses. The company's advisory suggests AI voice cloning may have been involved, warning that such technology can convincingly mimic family members' voices, increasing risk for seniors on the island.
Scammers Reportedly Using Deepfake Video Calls to Impersonate Executives in Singapore and Orchestrate Corporate Bank Transfers
Scammers in Singapore are reportedly using AI-generated deepfake video calls to impersonate corporate executives. The calls seek to deceive employees into authorizing fraudulent bank transfers. Usually, it is reported, victims will receive WhatsApp messages inviting them to Zoom meetings. During the calls, the scammers are disguised as senior leaders and will instruct the employees to transfer company funds for fake business transactions and to disclose personal data.
Misleading Deepfake Video of Trump Mocking Zelenskyy for Clothing Goes Viral on Facebook
In March 2025, an AI-generated deepfake video of Donald Trump criticizing Ukrainian President Volodymyr Zelenskyy for his clothing circulated widely on Facebook. In the video, Trump mocks Zelenskyy by calling him "Temu Zelenskyy." The video was created by a parody YouTube channel using AI voice and face synthesis tools, but it was reportedly mistaken by some viewers as real.
Attackers Reportedly Deployed Simulated AI Support Chatbot to Trick Instagram Business Users into Adding Malicious 2FA Login
A phishing campaign has reportedly been impersonating Meta support using a fake chatbot interface to hijack Instagram Business accounts. Victims received emails claiming ad violations and were directed to a fraudulent site mimicking Meta's support. There, a simulated chatbot instructed users to add the attacker’s Authenticator app as a secure login method, enabling account takeover. It remains unclear whether the chatbot used AI or was human-operated via a bot-like interface. See editor's note.
Financial Times Journalist Martin Wolf Reports AI-Generated Investment Scam Using His Likeness on Instagram and Facebook
Beginning in March 2025, purported deepfakes impersonating Financial Times columnist Martin Wolf were distributed via ads on Facebook and Instagram, promoting an alleged fraudulent investment group. Despite repeated takedowns, the ads have reportedly persisted under new accounts. Meta data reportedly showed at least 1,700 ads reached over 970,000 users in the EU alone. The impersonations allegedly used AI-generated visuals and voice clones to mimic Wolf's likeness and mislead users.
Chinese Actor and CPPCC Member Jin Dong Allegedly Impersonated by AI Deepfake Scammers to Mislead and Defraud Fans
Jin Dong, an actor from China and a member of the Chinese People's Political Consultative Conference (CPPCC), has warned about criminals using deepfake technology to impersonate him. The scammers are reportedly using his likeness and cloning his voice to deceive and defraud elderly individuals. In addition to his warning, Jin Dong has called for legislation and tech regulations to curb AI abuse.
AI-Generated OB-GYN Health Influencers on TikTok Used Fake Medical Credentials to Promote Dubious Advice
AI-generated avatars posing as OB-GYNs on TikTok, part of the so-called, crudely termed "Coochie Doctor" trend, have been falsely claiming years of experience while promoting dubious health advice. Many, including an avatar named "Violet," were created using the Captions app, which generates scripted AI influencers.
AI-Generated Songs Allegedly Imitating Céline Dion Circulate Online Without Authorization
Céline Dion has publicly condemned AI-generated music that falsely claims to feature her voice without her permission. In a March 7, 2025 statement, her team warned fans that these recordings are fake and unauthorized.
Deepfake Videos Allegedly Use AI-Generated Voice Clone of Singapore Prime Minister Lawrence Wong to Promote Scams
Singapore Prime Minister Lawrence Wong issued a warning about AI-generated deepfake videos and voice clones falsely portraying him promoting cryptocurrency scams, money-making schemes, and PR services. The manipulated content, seen on social media, reportedly uses public footage and AI voice cloning to deceive victims. Wong urged the public to avoid engaging, report scams via ScamShield, and stay vigilant.
ChatGPT Was Allegedly Consulted About Attack Options Before Teen Attempted to Stab Officer at Tira, Israel, Police Station
A 16-year-old from Tira, Israel, allegedly entered the city's police station with a knife and attempted to stab a Border Police officer. Prosecutors reportedly alleged that before the attack he had consulted ChatGPT about possible attacks and courses of action. He was charged in juvenile court with attempted aggravated assault as an act of terror. Public reporting does not establish what responses ChatGPT provided or whether they materially assisted the attempted attack.
Tbilisi-Based Call Center Allegedly Uses AI-Driven Scripts to Defraud Over 6,000 Victims of $35 Million
A large-scale AI-assisted financial scam, allegedly operated from Tbilisi, Georgia, used deepfake celebrity endorsements and manipulated victims through fraudulent trading dashboards that simulated high returns. Call center agents, trained with AI-driven persuasion tactics, convinced individuals to invest more money while falsely promising profits. Many reportedly lost their life savings, with the total losses reaching $35M across more than 6,000 victims.
Google Reports Alleged Gemini-Generated Terrorism and Child Exploitation to Australian eSafety Commission
Google reported to Australia's eSafety Commission that it received 258 complaints globally about AI-generated deepfake terrorism content and 86 about child abuse material made with its Gemini AI. The regulator called this a "world-first insight" into AI misuse. While Google uses hash-matching to detect child abuse content, it lacks a similar system for extremist material.