AI Incidents
Real-world cases where AI systems caused harm, classified by risk domain and entity. Data sourced from
AIID and classified by MIT AI Risk Initiative. CC BY-SA 4.0
741 incidents
Facial Recognition Error Reportedly Leads to Wrongful Arrest of Georgia Man and $200K Settlement in Louisiana
In November 2022, Randal "Quran" Reid was arrested in Georgia based on warrants from Louisiana that reportedly stemmed from a purportedly faulty facial recognition match using Clearview AI. Despite reportedly having never visited Louisiana, Reid was jailed for six days before authorities withdrew the warrants. No corroborating evidence had been gathered, and the technology's use was omitted from legal documents. In May 2025, Jefferson Parish settled with Reid for $200,000 in a federal civil rights lawsuit.
False Arrest of Georgia Man Due to Louisiana Police's Faulty Facial Recognition Technology
The Jefferson Parish Sheriff’s Office in Louisiana relied on facial recognition technology to identify suspects for the alleged theft of luxury purses, resulting in a man in Georgia, Randal Reid, being arrested. However, the technology produced a false match, leading to Reid's arrest and subsequent release. This incident highlights the potential pitfalls of facial recognition technology in law enforcement.
Sudden Braking by Tesla Allegedly on Self-Driving Mode Caused Multi-Car Pileup in Tunnel
A Tesla driver alleged Full Self Driving (FSD) braking unexpectedly as the cause for an eight-car pileup in San Francisco which led to minor injuries of nine people.
Lensa AI's Produced Unintended Sexually Explicit or Suggestive "Magic Avatars" for Women
Lensa AI's "Magic Avatars" were reportedly generating sexually explicit and sexualized features disproportionately for women and Asian women despite not submitting any sexual content.
Meta AI's Scientific Paper Generator Reportedly Produced Inaccurate and Harmful Content
Meta AI trained and hosted a scientific paper generator that sometimes produced bad science and prohibited queries on topics and groups that are likely to produce offensive or harmful content.
Apple Devices Mistook Skiing Activities, Dialed False Distress Emergency Calls
Apple devices of skiers and snowboarders reportedly misclassified winter activities as accidents, which resulted in numerous false inadvertent distress calls to 911 dispatchers.
CNET's Published AI-Written Articles Ran into Quality and Accuracy Issues
AI-written articles published by CNET reportedly contained factual errors which bypassed human editorial review, prompting the company to issue corrections and updates.
Article-Writing AI by CNET Allegedly Committed Plagiarism
CNET's use of generative AI to write articles allegedly ran into plagiarism issues, reproducing verbatim phrases from other published sources or making minor changes to existing texts such as altering capitalization, swapping out words for synonyms, and changing minor syntax.
Air Canada Chatbot Reportedly Provides Inaccurate Bereavement Fare Information, Leading to Customer Overpayment
A Canadian small claims tribunal reportedly ordered Air Canada to pay $812.02 in damages and court fees after its website chatbot allegedly provided inaccurate information about bereavement fare eligibility, leading a customer to overpay for flights. The tribunal reportedly found the airline responsible for information presented by its chatbot, rejecting the argument that the chatbot was a separate legal entity, and characterized the error as negligent misrepresentation.
KFC Sent Insensitive Kristallnacht Promotion via Holiday Detection System
KFC cited an error in an automated holiday detection system which identified the anniversary of Kristallnacht and prompted an insensitive push notification promoting its chicken.
Google Home Mini Speaker Reportedly Read N-Word in Song Title Aloud
Google Home Mini speaker was reported by users for announcing aloud the previously-censored n-word in a song title.
Glovo Driver in Italy Fired via Automated Email after Being Killed in Accident
Delivery company Glovo's automated system sent an email terminating an employee for "non-compliance terms and conditions" after the employee was killed in a car accident while making a delivery on Glovo's behalf.
XPeng P7 Crashed into Truck in Shangdong While on Automatic Navigation Assisted Driving
An XPeng P7 was operating on Navigation Guided Pilot (NGP) mode automatic navigation assisted driving system as it collided with a truck on a highway in Shandong, causing slight injuries to its driver.
Delivery Robot Rolled Through Crime Scene
A Serve Robotics delivery robot was shown on video rolling through a crime scene blocked off by police tape.
Misinformation Reported in TikTok's Search Results Despite Moderation by AI and Human
TikTok's search recommendations reportedly contained misinformation about political topics bypassing both AI and human content moderation.