AI Incidents
Real-world cases where AI systems caused harm, classified by risk domain and entity. Data sourced from 
AIID and classified by 
MIT AI Risk Initiative. CC BY-SA 4.0
1,751 incidents
Honda's CMBS False Positives Allegedly Caused Accidents to Customers
Honda's Collision Mitigation Braking System (CMBS) allegedly caused accidents to consumers due to frequent instances of false obstacle detection.
ByteDance Allegedly Trained "For You" Algorithm Using Content Scraped without Consent from Other Social Platforms
ByteDance allegedly scraped short-form videos, usernames, profile pictures, and descriptions of accounts on Instagram, Snapchat, and other sources, and uploaded them without consent on Flipagram, TikTok’s predecessor, in order to improve its “For You” algorithm's performance on American users.
PimEyes's Facial Recognition AI Allegedly Lacked Safeguards to Prevent Itself from Being Abused
PimEyes offered its subscription-based AI service to anyone in the public to search for matching facial images across the internet, which critics said lacked public oversight and government rules to prevent itself from misuse such as stalking women.
RealPage's YieldStar Allegedly Facilitated Rent Price Coordination Among Canadian Landlords
RealPage’s YieldStar algorithm is alleged to have enabled Canadian landlords to coordinate rental pricing by utilizing sensitive, non-public market data. The software has been accused of contributing to rent increases in non-rent-controlled units through purported collusion and artificial price inflation. Tenants have reported significant rent hikes, which they attribute to landlords' use of the algorithm.
Amazon India Allegedly Rigged Search Results to Promote Own Products
Amazon India allegedly copied products and rigged search algorithm to boost its own brands in search ranking, violating antitrust laws.
Alexa Plays Pornography Instead of Kids Song
An Amazon Echo Dot using the Amazon Alex software started to play pornographic results when a child asked it to play a song.
Reinforcement Learning Reward Functions in Video Games
OpenAI published a post about its findings when using Universe, a software for measuring and training AI agents to conduct reinforcement learning experiments, showing that the AI agent did not act in the way intended to complete a videogame.
“Amazon’s Choice” Algorithm Failed to Recommend Functional Products and Prone to Review Manipulation
Amazon’s “Amazon’s Choice” algorithm recommended poor-quality defective products and were reportedly susceptible to manipulation by inauthentic reviews.
Passport checker Detects Asian man's Eyes as Closed
New Zealand passport robot reader rejects the application of an applicant with Asian descent and says his eyes are closed.
Robot at a Chinese Tech Fair Smashed a Glass Booth, Injuring a Visitor
At the 18th China Hi-Tech Fair, a robot suddenly smashed through a glass booth and injured a visitor, after a staff member reportedly mistakenly pressed a button, causing it to reverse and accelerate.
Poor Performance of Tesla Factory Robots
The goal of manufacturing 2,500 Tesla Model 3's per week was falling short by 500 cars/week, and employees had to be "borrowed" from Panasonic in a shared factory to help hand-assemble lithium batteries for Tesla.
NYPD's Deployment of Facial Recognition Cameras Reportedly Reinforced Biased Policing
New York Police Department’s use of facial recognition deployment of surveillance cameras were shown using crowdsourced volunteer data reinforcing discriminatory policing against minority communities.
Government Deployed Extreme Surveillance Technologies to Monitor and Target Muslim Minorities in Xinjiang
A suite of AI-powered digital surveillance systems involving facial recognition and analysis of biometric data were deployed by the Chinese government in Xinjiang to monitor and discriminate local Uyghur and other Turkic Muslims.
Tesla FSD Reportedly Increased Crash Risk, Prompting Recall
A component of Tesla Full Self Driving system was deemed by regulators to increase crash risk such as by exceeding speed limits or by traveling through intersections unlawfully or unpredictably, prompting recall for hundreds of thousands of vehicles.
LinkedIn Search Prefers Male Names
An investigation by The Seattle Times in 2016 found a gender bias in LinkedIn's search engine.