AI Incidents
Real-world cases where AI systems caused harm, classified by risk domain and entity. Data sourced from
AIID and classified by MIT AI Risk Initiative. CC BY-SA 4.0
464 incidents
AI Voice Clone of Texas Woman Used in Distress Scam Targeting Brother in Port Neches
Jace Edgar of Port Neches, Texas reportedly received a scam phone call using AI-generated voice cloning to mimic his sister in distress. Believing she had been in an accident, Edgar began to act before noticing the caller avoided direct questions. When he contacted his sister, she was unharmed and unaware of the call. Authorities confirmed this was part of a broader rise in AI-powered scams, urging the public to stay vigilant and avoid sharing personal info with unknown callers.
Reported Use of AI Apps to Create Sexualized Deepfake Images of High School Students at Cascade High School in Iowa
Students of the Western Dubuque Community School District in Iowa reported that classmates allegedly used AI-enabled applications to generate sexualized deepfake images depicting fellow students. According to local reporting and the Dubuque County Sheriff's Office, the fabricated images were created and shared without consent. The school district reportedly held a public session to address policy gaps and student support following the incident.
Manipulated Video Using AI-Generated Audio Targets Pakistan's Prime Minister Shehbaz Sharif with Fabricated Interview
A viral video falsely claimed to show Layal al-Ekhtiar of Al Arabiya confronting Pakistan's Prime Minister Shehbaz Sharif over funding a 30-person Umrah delegation with public money while seeking aid from Saudi Arabia. Investigators concluded the video had been dubbed with AI-generated audio. The original interview was broadcast by Saudi-owned Al Arabiya in January 2023, and it contained no such exchange. Lip-sync inconsistencies reportedly confirmed the manipulation.
Alleged Fraudulent Prompts via AIXBT Dashboard Led Purported AI Trading Agent to Transfer 55.5 ETH from Simulacrum Wallet
A reported hacker attack allegedly compromised the autonomous AI crypto bot AIXBT, purportedly resulting in the theft of 55.5 ETH (approximately $106,200). The attacker is reported to have infiltrated the secure dashboard of the AIXBT autonomous system at 2:00 AM UTC on March 18, 2025, and allegedly queued two fraudulent prompts that instructed the AI agent to transfer funds from its simulacrum wallet.
AI-Enabled Organized Crime Expands Across Europe
Europol’s EU Serious and Organised Crime Threat Assessment (EU-SOCTA) 2025 warns that AI is accelerating the growth of organized crime throughout Europe. Criminal networks are leveraging AI for cyber fraud, ransomware, money laundering, and child exploitation, while AI-powered social engineering and automation are making criminal operations more scalable and harder to detect.
Alleged Use of AI to Create Sexualized Deepfake Images of Middle School Students Under Investigation in Bucks County, Pennsylvania
Authorities in Bucks County, Pennsylvania reported that a middle school student allegedly used AI-enabled tools to create sexualized deepfake images depicting classmates. The incident, which reportedly occurred in March 2025, involved images generated without consent and is under investigation by local police and the district attorney's office. The alleged conduct may fall under a new Pennsylvania law addressing non-consensual AI-generated sexual imagery, particularly involving minors.
Alleged AI-Generated IRS Scam Websites Used to Defraud U.S. Taxpayers
Scammers have allegedly been using AI-generated imposter websites and phishing emails to impersonate the IRS. They have reportedly been tricking taxpayers into providing personal and financial information. There has been a reported surge in tax-related AI scams leading up to Tax Day 2025, with fraudulent domains mimicking IRS services, along with fake websites, emails, and text messages. The IRS has warned taxpayers to verify official sites and avoid unsolicited links.
Docomo Pacific CEO Reports Mother Targeted by Purported AI-Enabled Scam in Guam
Docomo Pacific's CEO, Christine Baleto, disclosed that her elderly mother was targeted by an alleged AI-enabled scam call on Guam. The scammer reportedly posed as a federal agent and used personal details and intimidation, demanding sensitive information under false pretenses. The company's advisory suggests AI voice cloning may have been involved, warning that such technology can convincingly mimic family members' voices, increasing risk for seniors on the island.
Scammers Reportedly Using Deepfake Video Calls to Impersonate Executives in Singapore and Orchestrate Corporate Bank Transfers
Scammers in Singapore are reportedly using AI-generated deepfake video calls to impersonate corporate executives. The calls seek to deceive employees into authorizing fraudulent bank transfers. Usually, it is reported, victims will receive WhatsApp messages inviting them to Zoom meetings. During the calls, the scammers are disguised as senior leaders and will instruct the employees to transfer company funds for fake business transactions and to disclose personal data.
Misleading Deepfake Video of Trump Mocking Zelenskyy for Clothing Goes Viral on Facebook
In March 2025, an AI-generated deepfake video of Donald Trump criticizing Ukrainian President Volodymyr Zelenskyy for his clothing circulated widely on Facebook. In the video, Trump mocks Zelenskyy by calling him "Temu Zelenskyy." The video was created by a parody YouTube channel using AI voice and face synthesis tools, but it was reportedly mistaken by some viewers as real.
Attackers Reportedly Deployed Simulated AI Support Chatbot to Trick Instagram Business Users into Adding Malicious 2FA Login
A phishing campaign has reportedly been impersonating Meta support using a fake chatbot interface to hijack Instagram Business accounts. Victims received emails claiming ad violations and were directed to a fraudulent site mimicking Meta's support. There, a simulated chatbot instructed users to add the attacker’s Authenticator app as a secure login method, enabling account takeover. It remains unclear whether the chatbot used AI or was human-operated via a bot-like interface. See editor's note.
Chinese Actor and CPPCC Member Jin Dong Allegedly Impersonated by AI Deepfake Scammers to Mislead and Defraud Fans
Jin Dong, an actor from China and a member of the Chinese People's Political Consultative Conference (CPPCC), has warned about criminals using deepfake technology to impersonate him. The scammers are reportedly using his likeness and cloning his voice to deceive and defraud elderly individuals. In addition to his warning, Jin Dong has called for legislation and tech regulations to curb AI abuse.
AI-Generated OB-GYN Health Influencers on TikTok Used Fake Medical Credentials to Promote Dubious Advice
AI-generated avatars posing as OB-GYNs on TikTok, part of the so-called, crudely termed "Coochie Doctor" trend, have been falsely claiming years of experience while promoting dubious health advice. Many, including an avatar named "Violet," were created using the Captions app, which generates scripted AI influencers.
Deepfake Videos Allegedly Use AI-Generated Voice Clone of Singapore Prime Minister Lawrence Wong to Promote Scams
Singapore Prime Minister Lawrence Wong issued a warning about AI-generated deepfake videos and voice clones falsely portraying him promoting cryptocurrency scams, money-making schemes, and PR services. The manipulated content, seen on social media, reportedly uses public footage and AI voice cloning to deceive victims. Wong urged the public to avoid engaging, report scams via ScamShield, and stay vigilant.
ChatGPT Was Allegedly Consulted About Attack Options Before Teen Attempted to Stab Officer at Tira, Israel, Police Station
A 16-year-old from Tira, Israel, allegedly entered the city's police station with a knife and attempted to stab a Border Police officer. Prosecutors reportedly alleged that before the attack he had consulted ChatGPT about possible attacks and courses of action. He was charged in juvenile court with attempted aggravated assault as an act of terror. Public reporting does not establish what responses ChatGPT provided or whether they materially assisted the attempted attack.