AI Incidents
Real-world cases where AI systems caused harm, classified by risk domain and entity. Data sourced from 
AIID and classified by 
MIT AI Risk Initiative. CC BY-SA 4.0
682 incidents
A Tesla Crashed into and Killed a Road Sweeper on a Highway in China
A Tesla Model S collided with and killed a road sweeper on a highway near Handan, China, an accident where Tesla previously said it was not able to determine whether Autopilot was operating at the time of the crash.
Arkansas's Opaque Algorithm to Allocate Health Care Excessively Cut Down Hours for Beneficiaries
Beneficiaries of the Arkansas Department of Human Services (DHS)'s Medicaid waiver program were allocated excessively fewer hours of caretaker visit via an algorithm deployed to boost efficiency, which reportedly contained errors and whose outputs varied wildly despite small input changes.
Amazon Alexa Responding to Environmental Inputs
There are multiple reports of Amazon Alexa products (Echo, Echo Dot) reacting and acting upon unintended stimulus, usually from television commercials or news reporter's voices.
Predictive Policing Biases of PredPol
Predictive policing algorithms meant to aid law enforcement by predicting future crime show signs of biased output.
YouTube Recommendations Allegedly Promoted Radicalizing Material Contributing to Terrorist Acts
Family of Nohemi Gonzalez alleged YouTube recommendation systems led people to propaganda videos for the Islamic State which subsequently radicalized them to carry out the killing of 130 people in the 2015 Paris terrorist attack, including Ms. Gonzalez.
Inappropriate Gmail Smart Reply Suggestions
Google's Gmail Smart Reply tool was over-recommending the response "I love you" in situations where it was deemed innappropriate.
YouTube Recommendations Implicated in Political Radicalization of User
YouTube’s personalization and recommendation algorithms were alleged to have pushed and exposed its young male users to political extremism and misinformation, driving them towards far-right ideologies such as neo-Nazism and white supremacy.
Facebook's Friend Suggestion Feature Recommends Patients of Psychiatrist to Each Other
Facebook's "People You May Know" (PYMK) feature was reported by a psychiatrist for recommending her patients as friends through recommendations, violating patients' privacy and confidentiality.
Collection of Robotic Surgery Malfunctions
Study on database reports of robotic surgery malfunctions (8,061), including those ending in injury (1,391) and death (144), between 2000 and 2013.
Worker killed by robot in welding accident at car parts factory in India
A factory robot at the SKH Metals Factory in Manesar, India pierced and killed 24-year-old worker Ramji Lal when Lal reached behind the machine to dislodge a piece of metal stuck in the machine.
Australian Automated Debt Assessment System Issued False Notices to Thousands
Australian Department of Human Services (DHS)’s automated debt assessment system issued false or incorrect debt notices to hundreds of thousands of people, resulting in years-long lawsuits and damages to welfare recipients.
Google and Delphi Self-Driving Prototypes Allegedly Involved in Near-Miss on San Antonio Road, Palo Alto
A Delphi self-driving Audi Q5 prototype reportedly aborted a lane change after a Google self-driving Lexus RX400h allegedly cut in front of it on San Antonio Road in Palo Alto, California. According to Delphi executive John Absmeier, the Delphi car "took appropriate action" to avoid collision. No crash or injuries occurred.
Images of Black People Labeled as Gorillas
Google Photos image processing software mistakenly labelled a black couple as "gorillas."
Facebook's AI-Supported Moderation Failed to Classify Terrorist Content in East African Languages
Facebook's system involving algorithmic content moderation for East African languages was reportedly failing to identify violating content on the platform such as mistakenly classifying non-terrorist content.
Google’s YouTube Kids App Presents Inappropriate Content
YouTube’s content filtering and recommendation algorithms exposed children to disturbing and inappropriate videos.