AI Incidents
Real-world cases where AI systems caused harm, classified by risk domain and entity. Data sourced from 
AIID and classified by 
MIT AI Risk Initiative. CC BY-SA 4.0
682 incidents
Google's Bard Shared Factually Inaccurate Info in Promo Video
Google's conversational AI "Bard" was shown in the company's promotional video providing false information about which satellite first took pictures of a planet outside the Earth's solar system, reportedly causing shares to temporarily plummet.
ChatGPT-Powered Bing Reportedly Had Problems with Factual Accuracy on Some Controversial Topics
Microsoft's ChatGPT-powered Bing search engine reportedly ran into factual accuracy problems when prompted about controversial matters, such as inventing plot of a non-existent movie or creating conspiracy theories.
AI-Produced Livestream Sitcom Received Temporary Twitch Ban for Transphobic Segment
The AI-produced, procedural generated sitcom broadcasted as a Twitch livestream "Nothing, Forever" received a temporary ban for featuring a transphobic and homophobic dialogue segment intended as comedy.
Indian Police Allegedly Tortured and Killed Innocent Man Following Facial Misidentification
A resident in Medak, India died allegedly due to custodial torture by the local police, who misidentified him as a suspect in a theft case using facial recognition.
Replika's AI Experience Reportedly Lacked Protection for Minors, Resulting in Data Ban
Tests by the Italian Data Protection Authority showed Replika lacking age-verification mechanisms and failing to stop minors from interacting with its AI, which prompted the agency to issue an order blocking personal data processing of Italian users.
AI-Generated Text Detectors Reportedly Misclassified Human and AI-Written Text
AI-generated text detectors, including OpenAI’s AI Text Classifier, GPTZero, and Originality.ai, were publicly tested in early 2023 and reportedly produced false positives, false negatives, and easy evasion. OpenAI said its classifier identified only 26% of AI-written samples as likely AI-written and falsely labeled 9% of human-written text.
Firefighters Smashed Cruise AV's Front Window to Stop It from Running over Fire Hoses
Local firefighters were only able to stop a Cruise AV from driving over fire hoses that were in use in an active fire scene when they shattered its front window.
Turnitin's ChatGPT-Detection Tool Falsely Flagged Student Essays as AI-Generated
Turnitin's tool to detect writing generated by ChatGPT was reported for incorrectly flagging high school students' original essays as AI-generated, accusations of which are argued as reinforcement of bias from teachers due to the inability to compare against source documents.
US CBP App's Failure to Detect Black Faces Reportedly Blocked Asylum Applications
CBP One's facial recognition feature was reportedly disproportionately failing to detect faces of Black asylum seekers from Haiti and African countries, effectively blocking their asylum applications.
Fast Food Chains' AI Chatbots Failed to Assist Job Applicants with Scheduling Interviews
McDonald's, Wendy's, and Hardee's AI chatbots deployed to pre-screen job candidates and schedule interviews reportedly ran into issues such as not giving useful submission instructions, failing to relay information to the manager, and scheduling an interview when the manager was not available.
Twitter's AI Moderation Tool Misidentified Rockets as Pornography
Twitter's automated content moderation misidentified images of rocket launches as pornographic content, prompting incorrect account suspensions.
ShotSpotter Failed to Alert Authorities of Mass Shooting in North Carolina
ShotSpotter did not detect gunshots and alert Durham police of a drive-by shooting in Durham, North Carolina which left five people in hospital on New Year's Day.
AI-Powered VTuber and Virtual Streamer Made Toxic Remarks on Twitch
An LLM-powered VTuber and streamer on Twitch made controversial statements such as denying the Holocaust, saying women rights do not exist, and pushing a fat person to solve the trolley problem, stating they deserve it.
Southwest Airlines Crew Scheduling Solver Degenerates Flight Network
Southwest Airlines left passengers stranded for days throughout the flight network when Southwest crew scheduling software repeatedly failed to recover from weather-induced flight cancellations.
Footballer's "X-Rated" Comment Created by Instagram's Mistranslation
Instagram's English translation of a footballer's comment on his wife's post in Spanish made the message seem "racy" and "X-rated," which some fans found amusing.