AI Incidents
Real-world cases where AI systems caused harm, classified by risk domain and entity. Data sourced from 
AIID and classified by 
MIT AI Risk Initiative. CC BY-SA 4.0
1,751 incidents
Purported AI Voice Scam Reportedly Targets Westchester Parents with Fake Kidnapping Ransom Calls
Scammers reportedly used AI voice synthesis to mimic children's voices in fake kidnapping calls, allegedly demanding ransom payments from parents in the Peekskill School District of Westchester, New York. The synthetic voices were reportedly generated from social media voice samples.
Tesla's 'Actually Smart Summon' Feature Reportedly Linked to Multiple Parking Lot Collisions
Tesla's "Actually Smart Summon" feature, a remote parking system controlled via a smartphone app, reportedly failed to detect obstacles such as cars, walls, and parking signs, resulting in at least 16 collision incidents. The NHTSA is investigating safety concerns, including delayed user response times, potential overreliance on camera-only navigation, and noncompliance with crash reporting rules.
Sydney High Schooler Allegedly Generated Deepfakes of Other Students
A Sydney high school student allegedly used AI platforms to create explicit deepfake images of female classmates, which were then distributed through fake social media accounts. The incident reportedly caused significant distress among the victims, leading to an investigation by Campbelltown city police area command and involvement from the eSafety Commissioner.
Alleged Deepfake of New Zealand Endocrinologist Reportedly Promotes Misleading Diabetes Claim
A video circulated on social media that appeared to feature University of Otago endocrinologist Sir Jim Mann allegedly promoting a hemp gummy product for diabetes patients and urging them to stop using metformin. The video was reportedly generated using AI and has been described as spreading manipulated visuals and speech presenting false medical advice.
Aspiring Artist Cherelle Kozak Reportedly Targeted by AI-Powered Impersonation of Rapper Fat Joe
An aspiring artist in Austin, Texas, Cherelle Kozak, was targeted by a scammer using AI-generated video and voice to impersonate rapper Fat Joe. The impersonator appeared on a call, encouraged her to upload music for supposed radio play, and then demanded payment. Kozak did not comply. The scam closely resembled one that Fat Joe publicly warned about on January 5, 2025.
Hong Kong Authorities Seize HK$34M in Alleged Deepfake Scam Targeting Victims in Taiwan, Singapore, and Malaysia
Hong Kong police arrested 31 people linked to a deepfake scam syndicate that allegedly defrauded victims in Taiwan, Singapore, and Malaysia. The group used AI-generated images to impersonate wealthy women, training recruits to discuss luxury lifestyles, finance, and cryptocurrency to gain trust. Scammers reportedly persuaded victims to invest in fraudulent schemes, with police intercepting HK$34 million in illicit proceeds.
Meta AI Characters Allegedly Exhibited Racism, Fabricated Identities, and Exploited User Trust
Meta deployed AI-generated profiles on its platforms, including Instagram and Facebook, as part of an experiment. The profiles, such as "Liv" and "Grandpa Brian," allegedly featured fabricated identities and misleading diversity claims. These accounts also allegedly manipulated user emotions for engagement and profit. Reportedly, backlash over offensive and deceptive content led Meta to delete the profiles on January 3rd, 2025, citing a blocking-related bug.
Russian Center for Geopolitical Expertise Allegedly Used AI to Target U.S. Candidates with Disinformation in 2024 Election
The Moscow-based Center for Geopolitical Expertise (CGE) allegedly used AI to produce and spread deepfakes and disinformation targeting U.S. political candidates during the 2024 general election, aiming to sway public opinion and disrupt the electoral process. On December 31, 2024, the U.S. Treasury Department imposed sanctions against the CGE and its director, Valery Korovin, for their reported role in this interference.
AI-Generated Reading Summaries on Fable App Reportedly Wrote Biased and Offensive Commentary
Fable, a book-focused social app, used OpenAI’s API to generate AI-powered year-end reading summaries in December 2024. These summaries allegedly produced biased and offensive remarks about race, gender, and sexual orientation. Fable is reported to have apologized in a social media post on January 1, 2025.
Waymo Robotaxi Allegedly Collides With Serve Robotics Delivery Bot in Los Angeles
A Waymo robotaxi reportedly collided with a Serve Robotics delivery robot at a West Hollywood intersection on December 27th, 2024. The delivery robot reportedly moved into the vehicle turning lane as the robotaxi approached, leading to a low-speed collision.
ChatGPT Reportedly Referenced During Las Vegas Cybertruck Explosion Planning
Matthew Livelsberger, the suspect in the 2025 Las Vegas Cybertruck explosion, reportedly used ChatGPT to search for publicly available information on explosives, ammunition, and fireworks regulations. ChatGPT is alleged to have played a role in the planning of the explosion outside the Trump International Hotel in Las Vegas. The information provided by ChatGPT, though, was reportedly general and available through other public sources.
Meta AI Bug in Deployed Service Reportedly Allowed Potential Access to Other Users' Prompts and Responses
A security researcher reported a vulnerability in Meta AI's deployed chatbot service that, under certain conditions, could allow an unauthorized user to view another user's prompts and AI-generated responses. The flaw reportedly involved guessable prompt IDs and insufficient server-side authorization checks. Meta reportedly fixed the issue in January 2025 and found no evidence of malicious exploitation, awarding the researcher a bug bounty.
Alleged Fake AI-Generated Christmas Card Featuring Prince Harry and Meghan Markle's Children Circulates on Social Media
An AI-generated Christmas card reportedly depicting Prince Harry and Meghan Markle’s children, Prince Archie and Princess Lilibet, was shared on social media as if it were authentic. The image is reported to have been created using older public photos and flawed AI editing.
Alleged Deepfake of Luis Suárez Used to Scam Uruguayans in Fake Investment Scheme
On December 26, 2024, UTE, Uruguay's public utility company, warned of an alleged deepfake video circulating on Instagram, Facebook, and Threads. The video reportedly features manipulated images and voice of footballer Luis Suárez, falsely promoting an investment scheme claiming a 10,400 peso investment could yield 175,000 pesos monthly. It also reportedly uses AI-altered Telemundo footage. UTE urged the public not to share personal data, as the scam links to phishing sites posing as official sources.
BP New Zealand's License Plate Recognition System Reportedly Misidentified Auckland Driver for Fuel Theft in Whanganui
BP’s license plate recognition system reportedly misidentified Auckland resident Buddhika Rajapakse as responsible for petrol theft in Whanganui. Despite the suspect vehicle being a different make, model, and color, the system allegedly linked Rajapakse’s plate to the thefts. BP has reportedly acknowledged a possible doctored plate but still sent multiple payment requests. Rajapakse has reportedly been forced to contest the claims multiple times.