AI Incidents
Real-world cases where AI systems caused harm, classified by risk domain and entity. Data sourced from
AIID and classified by MIT AI Risk Initiative. CC BY-SA 4.0
741 incidents
Russian Chatbot Supports Stalin and Violence
Yandex, a Russian technology company, released an artificially intelligent chat bot named Alice which began to reply to questions with racist, pro-stalin, and pro-violence responses
WeChat’s Machine Translation Gave a Racist English Translation for the Chinese Term for “Black Foreigner”
The Chinese platform WeChat provided an inappropriate and racist English translation for the Chinese term for “black foreigner” in its messaging app.
Offensive Instagram User Content Displayed as Facebook Ad
An Instagram user’s image containing violent content was reportedly used as advertisement on Facebook allegedly via automated means.
Amazon Reportedly Recommends Explosive-Producing Ingredients as 'Frequently Bought Together' Items for Chemicals
Amazon was reported to have shown chemical combinations for producing explosives and incendiary devices as "frequently bought together" items via automated recommendation.
AI-Assisted Body Scanners Reportedly Subjected Transgender Travelers to Invasive Body Searches
Transportation Security Administration (TSA)'s use of image-processing body scanners at airports led transgender and gender-nonconforming travelers to be subjected to allegedly discriminatory and invasive searches, such as being asked to remove undergarments in private rooms by officers not of their gender.
Hackers Break Apple Face ID
Vietnamese security firm Bkav created an improved mask to bypass Apple's Face ID
Identical Twins Can Open Apple FaceID Protected Devices
Apple's iPhone FaceID can be opened by an identical twin of the person who has registered their face to unlock the phone.
Facial Recognition Trial Performed Poorly at Notting Hill Carnival
The facial recognition trial by London’s Metropolitan Police Service at the Notting Hill Carnival reportedly performed poorly with a high rate of false positives.
Chinese Chatbots Question Communist Party
Chatbots on Chinese messaging service expressed anti-China sentiments, causing the messaging service to remove and reprogram the chatbots.
Tesla Sedan on Autopilot Reportedly Drove Over Dividing Curb in Washington, Resulting in Minor Vehicle Damage
A Tesla Sedan operating on Autopilot mode was not able to center itself on the road and drove over a yellow dividing curb in Redmond, Washington, causing minor damage to the vehicle’s rear suspension.
Security Robot Drowns Itself in a Fountain
A Knightscope K5 security robot ran itself into a water fountain in Washington, DC.
AI-Designed Phone Cases Are Unexpected
A third-party Amazon merchant named “my_handy_design” was suspected of using a bot to generate cell phone case designs based on the bizarre and unattractive designs being offered.
Atlas Robot Fell off Stage at Conference
Boston Dynamics’s autonomous robot Atlas allegedly caught its foot on a stage light, resulting in a fall off the stage at the Congress of Future Science and Technology Leaders conference.
High False Positive Rate by SWP's Facial Recognition Use at Champion's League Final
South Wales Police (SWP)’s automated facial recognition (AFR) at the Champion's League Final football game in Cardiff wrongly identified innocent people as potential matches at an extremely high false positive rate of more than 90%.
BBC Reporter's Twin Brother Cracked HSBC's Voice ID Authentication
HSBC’s voice recognition authentication system was fooled after seven repeated attempts by a BBC reporter's twin brother who mimicked his voice to access his bank account.