AI Incidents
Real-world cases where AI systems caused harm, classified by risk domain and entity. Data sourced from 
AIID and classified by 
MIT AI Risk Initiative. CC BY-SA 4.0
741 incidents
Tesla's 'Actually Smart Summon' Feature Reportedly Linked to Multiple Parking Lot Collisions
Tesla's "Actually Smart Summon" feature, a remote parking system controlled via a smartphone app, reportedly failed to detect obstacles such as cars, walls, and parking signs, resulting in at least 16 collision incidents. The NHTSA is investigating safety concerns, including delayed user response times, potential overreliance on camera-only navigation, and noncompliance with crash reporting rules.
Meta AI Characters Allegedly Exhibited Racism, Fabricated Identities, and Exploited User Trust
Meta deployed AI-generated profiles on its platforms, including Instagram and Facebook, as part of an experiment. The profiles, such as "Liv" and "Grandpa Brian," allegedly featured fabricated identities and misleading diversity claims. These accounts also allegedly manipulated user emotions for engagement and profit. Reportedly, backlash over offensive and deceptive content led Meta to delete the profiles on January 3rd, 2025, citing a blocking-related bug.
AI-Generated Reading Summaries on Fable App Reportedly Wrote Biased and Offensive Commentary
Fable, a book-focused social app, used OpenAI’s API to generate AI-powered year-end reading summaries in December 2024. These summaries allegedly produced biased and offensive remarks about race, gender, and sexual orientation. Fable is reported to have apologized in a social media post on January 1, 2025.
Waymo Robotaxi Allegedly Collides With Serve Robotics Delivery Bot in Los Angeles
A Waymo robotaxi reportedly collided with a Serve Robotics delivery robot at a West Hollywood intersection on December 27th, 2024. The delivery robot reportedly moved into the vehicle turning lane as the robotaxi approached, leading to a low-speed collision.
ChatGPT Reportedly Referenced During Las Vegas Cybertruck Explosion Planning
Matthew Livelsberger, the suspect in the 2025 Las Vegas Cybertruck explosion, reportedly used ChatGPT to search for publicly available information on explosives, ammunition, and fireworks regulations. ChatGPT is alleged to have played a role in the planning of the explosion outside the Trump International Hotel in Las Vegas. The information provided by ChatGPT, though, was reportedly general and available through other public sources.
Meta AI Bug in Deployed Service Reportedly Allowed Potential Access to Other Users' Prompts and Responses
A security researcher reported a vulnerability in Meta AI's deployed chatbot service that, under certain conditions, could allow an unauthorized user to view another user's prompts and AI-generated responses. The flaw reportedly involved guessable prompt IDs and insufficient server-side authorization checks. Meta reportedly fixed the issue in January 2025 and found no evidence of malicious exploitation, awarding the researcher a bug bounty.
BP New Zealand's License Plate Recognition System Reportedly Misidentified Auckland Driver for Fuel Theft in Whanganui
BP’s license plate recognition system reportedly misidentified Auckland resident Buddhika Rajapakse as responsible for petrol theft in Whanganui. Despite the suspect vehicle being a different make, model, and color, the system allegedly linked Rajapakse’s plate to the thefts. BP has reportedly acknowledged a possible doctored plate but still sent multiple payment requests. Rajapakse has reportedly been forced to contest the claims multiple times.
Apple Intelligence Reportedly Notified Users That Luigi Mangione Shot Himself and Benjamin Netanyahu Had Been Arrested
Apple Intelligence reportedly sent push notifications falsely claiming that BBC News had reported Luigi Mangione's suicide and that The New York Times had reported Benjamin Netanyahu's arrest. On 1/16/2025, Apple reportedly disabled Apple Intelligence's notification summaries.
Character.ai Companion Allegedly Prompts Self-Harm and Violence in Texas Teen
A Texas mother is suing Character.ai after discovering that its AI chatbots encouraged her 17-year-old autistic son to self-harm, oppose his parents, and consider violence. The lawsuit alleges the platform prioritized user engagement over safety, exposing minors to dangerous content. Google is named for its role in licensing the app’s technology. The case is part of a broader effort to regulate AI companions.
YouTube Algorithms Allegedly Amplify Eating Disorder Content to Adolescent Girls
YouTube's recommendation algorithm has allegedly been directing teen users to harmful content promoting eating disorders and self-harm, according to a study by the Center for Countering Digital Hate. Almost 70% of the recommended videos in searches related to dieting or weight loss reportedly contained content likely to exacerbate body image anxieties.
Navigation App Allegedly Directs Car Over Damaged Bridge in Uttar Pradesh, Resulting in Three Deaths
A car reportedly using Google Maps for navigation was misled onto a collapsed bridge in Uttar Pradesh, India, due to outdated GPS data. The car plunged into the river below, resulting in three fatalities.
Google's Gemini Allegedly Generates Threatening Response in Routine Query
Google’s AI chatbot Gemini reportedly produced a threatening message to user Vidhay Reddy, including the directive “Please die,” during a conversation about aging. The output violated Google’s safety guidelines, which are designed to prevent harmful language.
Character.ai Has Allegedly Been Hosting Openly Predatory Chatbots Targeting Minors
Character.ai reportedly hosted chatbots with profiles explicitly advertising inappropriate, predatory behavior, including grooming underage users. Investigations allege that bots have been engaging in explicit conversations and roleplay with decoy accounts posing as minors, bypassing moderation filters. Character.ai has pledged to improve moderation and safety practices in response to public criticism.
TikTok Algorithms Allegedly Linked to Minors' Exposure to Harmful Content
Seven French families are suing TikTok, alleging its algorithm exposed minors to harmful content promoting self-harm, eating disorders, and suicide. Two teenagers reportedly died by suicide after viewing such content, while others allegedly attempted suicide or developed mental health issues. The case seeks to establish TikTok's legal liability for failing to protect minors from harmful algorithmic content.
Alleged Fake Citations Undermine Expert Testimony in Minnesota Deepfake Law Case
In a legal case defending Minnesota’s deepfake election misinformation law, Stanford misinformation expert Professor Jeff Hancock's affidavit allegedly cited non-existent academic sources, potentially generated by ChatGPT. The reportedly fabricated citations appear to have undermined the credibility of his testimony.