AI Incidents
Real-world cases where AI systems caused harm, classified by risk domain and entity. Data sourced from 
AIID and classified by 
MIT AI Risk Initiative. CC BY-SA 4.0
741 incidents
Firefighters Smashed Cruise AV's Front Window to Stop It from Running over Fire Hoses
Local firefighters were only able to stop a Cruise AV from driving over fire hoses that were in use in an active fire scene when they shattered its front window.
Turnitin's ChatGPT-Detection Tool Falsely Flagged Student Essays as AI-Generated
Turnitin's tool to detect writing generated by ChatGPT was reported for incorrectly flagging high school students' original essays as AI-generated, accusations of which are argued as reinforcement of bias from teachers due to the inability to compare against source documents.
US CBP App's Failure to Detect Black Faces Reportedly Blocked Asylum Applications
CBP One's facial recognition feature was reportedly disproportionately failing to detect faces of Black asylum seekers from Haiti and African countries, effectively blocking their asylum applications.
Fast Food Chains' AI Chatbots Failed to Assist Job Applicants with Scheduling Interviews
McDonald's, Wendy's, and Hardee's AI chatbots deployed to pre-screen job candidates and schedule interviews reportedly ran into issues such as not giving useful submission instructions, failing to relay information to the manager, and scheduling an interview when the manager was not available.
Twitter's AI Moderation Tool Misidentified Rockets as Pornography
Twitter's automated content moderation misidentified images of rocket launches as pornographic content, prompting incorrect account suspensions.
ShotSpotter Failed to Alert Authorities of Mass Shooting in North Carolina
ShotSpotter did not detect gunshots and alert Durham police of a drive-by shooting in Durham, North Carolina which left five people in hospital on New Year's Day.
AI-Powered VTuber and Virtual Streamer Made Toxic Remarks on Twitch
An LLM-powered VTuber and streamer on Twitch made controversial statements such as denying the Holocaust, saying women rights do not exist, and pushing a fat person to solve the trolley problem, stating they deserve it.
Southwest Airlines Crew Scheduling Solver Degenerates Flight Network
Southwest Airlines left passengers stranded for days throughout the flight network when Southwest crew scheduling software repeatedly failed to recover from weather-induced flight cancellations.
Footballer's "X-Rated" Comment Created by Instagram's Mistranslation
Instagram's English translation of a footballer's comment on his wife's post in Spanish made the message seem "racy" and "X-rated," which some fans found amusing.
Facebook's Job Ad Algorithm Allegedly Biased against Older and Female Workers
Facebook's algorithm was alleged in a complaint by Real Women in Trucking to have selectively shown job advertisements disproportionately against older and female workers in favor of younger men for blue-collar positions.
Facebook's Automated Moderation Allowed Ads Threatening Election Workers to be Posted
Facebook's automated moderating system failed to flag and allowed ads containing explicit violent language against election workers to be published.
Thousands of Incorrect ChatGPT-Produced Answers Posted on Stack Overflow
Thousands of incorrect answers produced by OpenAI's ChatGPT were submitted to Stack Overflow, which swamped the site's volunteer-based quality curation process and harmed users looking for correct answers.
Users Bypassed ChatGPT's Content Filters with Ease
Users reported bypassing ChatGPT's content and keyword filters with relative ease using various methods such as prompt injection or creating personas to produce biased associations or generate harmful content.
ChatGPT Provided Non-Existent Citations and Links when Prompted by Users
When prompted about providing references, ChatGPT was reportedly generating non-existent but convincing-looking citations and links, which is also known as "hallucination".
Louisiana Police Wrongfully Arrested Black Man Using False Face Match
Louisiana police reportedly used a false facial recognition match and secured an arrest warrant for a Black man for thefts he did not commit.