AI Incidents
Real-world cases where AI systems caused harm, classified by risk domain and entity. Data sourced from 
AIID and classified by 
MIT AI Risk Initiative. CC BY-SA 4.0
1,751 incidents
Alleged AI-Generated Clone of Exante Brokerage Used to Defraud U.S. Investor via JPMorgan Account
Scammers used AI tools to clone the broker Exante and defraud at least one U.S. victim by registering a JPMorgan Chase account and replicating Exante’s trading interface. AI-generated fake documents, deepfakes, and cloned websites enabled the scheme. Exante, which does not operate in the U.S., confirmed the fraud and filed reports with multiple U.S. agencies.
Norwegian Supreme Court Receives Legal Filing with Fabricated Citations Allegedly Generated by AI Tool
In early 2025, Norway’s Supreme Court (Høyesterett) received a legal filing containing hallucinated legal citations and quotes, allegedly inserted by an attorney using an AI tool without verification. The fabricated sources were detected during standard review. While no sanctions were issued, the Court updated its guidance to lawyers, warning that AI use does not exempt them from professional responsibility.
Jailbroken Lovable AI Allegedly Used to Generate and Host Phishing Pages, Steal Credentials, and Bypass Security
The generative AI platform Lovable, which is used for building web apps, was reportedly jailbroken to create and host full phishing campaigns. These campaigns allegedly included credential-harvesting login pages, evasion techniques, and real-time exfiltration via services like Telegram and Firebase. The AI system was reportedly used for generating the phishing content and and then deploying it live on a URL hosted under its own subdomain.
18-Year-Old Islamic State Supporter in Vienna, Austria, Reportedly Sought and Received Explosives Advice From ChatGPT Amid Disputed Embassy and Mosque Attack Allegations
An 18-year-old Islamic State supporter in Vienna, Austria, reportedly sought and received explosives advice from ChatGPT amid allegations of plans to attack the Israeli embassy and a Shiite Islamic center. He was convicted of terrorist association, threats, and coercion. The court acquitted him of terrorist training and instruction charges and found no evidence of preparations for a specific crime.
Deepfake Job Applicant Allegedly Used AI Tools to Apply for Remote Role at U.S. Security Startup
Voice authentication startup Pindrop Security reported a job candidate used deepfake software and other AI tools in an attempted scam. This is part of a growing trend in international scammers using AI tools to apply for remote US-based jobs, sometimes successfully.
Reported AI-Generated Video Purportedly Depicting Keanu Reeves Debating Elon Musk Circulates as Misinformation on Social Media
In April 2025, a video circulated online reportedly depicting a televised debate between Keanu Reeves and Elon Musk about AI. The video, posted by the YouTube channel Voices of Change, purportedly used AI-generated voice and visual content to simulate the event. Independent analysis found signs of deepfake audio and imagery, and no credible evidence supported the event's existence.
Malaysian Teenager Allegedly Arrested for Creating and Selling AI-Generated Deepfake Images of Schoolmates and Alumni in Johor
Authorities in Johor, Malaysia reportedly arrested a 16-year-old student who allegedly used AI-enabled tools to generate and sell deepfake images depicting schoolmates and former students. According to police, the images were created from social media photos and distributed online for payment. The alleged activity affected dozens of victims, including minors, some of whom may have been unaware of the misuse.
Jiushi Autonomous Delivery Vehicle Reportedly Dragged Fallen Electric Scooter During Delivery Run in Xianyang, Shaanxi
A Jiushi autonomous delivery vehicle reportedly operating on a delivery route in Xianyang, Shaanxi, was filmed dragging a fallen electric scooter that had allegedly been left in the road after an earlier traffic incident. Company statements said the vehicle attempted to avoid the scooter but failed to fully recognize its shape and position, causing part of it to become caught under a wheel. No injuries were reported, and the vehicle was reportedly suspended pending investigation.
Reported Darknet Launch of Xanthorox AI Introduces Autonomous Cyberattack Platform
Xanthorox AI is a malicious, modular AI system released on darknet forums in early 2025. Designed from scratch for offensive cyber operations, it runs on private infrastructure and includes models for code generation, phishing, malware, social engineering, and real-time voice/image input. Its release represents a deliberate deployment of an autonomous attack platform.
Alleged Deepfake Investment Scam in Spain Defrauds 208 Victims of €19 million ($20.9 million)
Spanish police arrested six individuals allegedly behind a €19M ($20.9M) global investment scam powered by AI. The operation used deepfake ads featuring national celebrities to deceive victims, many of whom were selected through targeting algorithms. Scammers posed as financial advisors and fake officials, cycling through romance baiting, investment fraud, and recovery scams. AI-generated content amplified trust and engagement.
Hong Kong Syndicate Allegedly Used AI-Generated Facial Composites to Open Bank Accounts
Hong Kong police reportedly arrested eight individuals accused of using purportedly AI-generated facial composites to open bank accounts with altered ID photos. Of 44 applications, 30 reportedly succeeded after passing online identity checks. The accounts were then allegedly used to apply for loans and make credit card purchases totaling HK$860,000, and to launder over HK$1.2 million in suspected criminal proceeds. Police linked the operation to local triad-affiliated fraud networks.
Purported Deepfake Depicts Altercation Between Bougainville President Ishmael Toroama and Papua New Guinea Prime Minister James Marape
A purported AI‑generated deepfake video circulated online falsely depicting a physical altercation between Bougainville President Ishmael Toroama and Papua New Guinea Prime Minister James Marape. The footage reportedly caused public confusion and risked damaging relations between Bougainville and Papua New Guinea. Toroama reportedly condemned the video as false and malicious, as well as potentially destabilizing, urging stronger action against misleading AI‑generated content.
Deepfake of Bermuda Premier David Burt Promotes Investment Scam Using Royal Gazette Branding
The Government of Bermuda warned the public about a deepfake video circulating on Facebook that falsely portrayed Premier David Burt promoting a government investment scheme. The deepfake video reportedly mimicked the branding of The Royal Gazette and was linked to fraudulent social media accounts. Authorities confirmed the content was fake and urged the public to report such scams and to be vigilant about them.
Essex Man Sentenced to Five Years in Prison for Having Generated and Shared Deepfake Pornography of at Least 20 Women and a Minor
Between March 2023 and May 2024, Brandon Tyler of Essex used AI to generate explicit deepfake pornography of at least 20 women he knew personally, including a 16-year-old. He manipulated their social media photos and shared them, along with their personal details, in online forums promoting sexual violence. He was sentenced to five years in prison in April 2025 under the UK's criminal law against sharing sexually explicit deepfakes, in what is one of the first major prosecutions of its kind.
AI Voice Clone of Texas Woman Used in Distress Scam Targeting Brother in Port Neches
Jace Edgar of Port Neches, Texas reportedly received a scam phone call using AI-generated voice cloning to mimic his sister in distress. Believing she had been in an accident, Edgar began to act before noticing the caller avoided direct questions. When he contacted his sister, she was unharmed and unaware of the call. Authorities confirmed this was part of a broader rise in AI-powered scams, urging the public to stay vigilant and avoid sharing personal info with unknown callers.