AI Incidents
Real-world cases where AI systems caused harm, classified by risk domain and entity. Data sourced from 
AIID and classified by 
MIT AI Risk Initiative. CC BY-SA 4.0
1,751 incidents
Twitter's AI Moderation Tool Misidentified Rockets as Pornography
Twitter's automated content moderation misidentified images of rocket launches as pornographic content, prompting incorrect account suspensions.
ShotSpotter Failed to Alert Authorities of Mass Shooting in North Carolina
ShotSpotter did not detect gunshots and alert Durham police of a drive-by shooting in Durham, North Carolina which left five people in hospital on New Year's Day.
Tesla Driver Put Car on Autopilot Before Falling Asleep in Germany
A Tesla driver fell asleep on an Autobahn near Bamberg, Germany after activating his vehicle's Autopilot mode, which did not respond to attempts to pull it over by the police.
AI-Powered VTuber and Virtual Streamer Made Toxic Remarks on Twitch
An LLM-powered VTuber and streamer on Twitch made controversial statements such as denying the Holocaust, saying women rights do not exist, and pushing a fat person to solve the trolley problem, stating they deserve it.
Southwest Airlines Crew Scheduling Solver Degenerates Flight Network
Southwest Airlines left passengers stranded for days throughout the flight network when Southwest crew scheduling software repeatedly failed to recover from weather-induced flight cancellations.
ChatGPT Abused to Develop Malicious Softwares
OpenAI's ChatGPT was reportedly abused by cyber criminals including ones with no or low levels of coding or development skills to develop malware, ransomware, and other malicious softwares.
Lawyers Denied Entry to Performance Venue by Facial Recognition
Lawyers were barred from entry to Madison Square Garden after a facial recognition system matched them as employed by a law firm currently engaged in litigation with the venue.
Footballer's "X-Rated" Comment Created by Instagram's Mistranslation
Instagram's English translation of a footballer's comment on his wife's post in Spanish made the message seem "racy" and "X-rated," which some fans found amusing.
Facebook's Job Ad Algorithm Allegedly Biased against Older and Female Workers
Facebook's algorithm was alleged in a complaint by Real Women in Trucking to have selectively shown job advertisements disproportionately against older and female workers in favor of younger men for blue-collar positions.
Facebook's Automated Moderation Allowed Ads Threatening Election Workers to be Posted
Facebook's automated moderating system failed to flag and allowed ads containing explicit violent language against election workers to be published.
Startup Misled Research Participants about GPT-3 Use in Mental Healthcare Support
OpenAI's GPT-3 was deployed by a mental health startup without ethical review to support peer-to-peer mental healthcare, and whose interactions with the help providers were "deceiving" for research participants.
AI Video-Making Tool Abused to Deploy Pro-China News on Social Media
Synthesia's AI-generated video-making tool was reportedly used by Spamouflage to disseminate pro-China propaganda news on social media using videos featuring highly realistic fictitious news anchors.
Thousands of Incorrect ChatGPT-Produced Answers Posted on Stack Overflow
Thousands of incorrect answers produced by OpenAI's ChatGPT were submitted to Stack Overflow, which swamped the site's volunteer-based quality curation process and harmed users looking for correct answers.
Users Bypassed ChatGPT's Content Filters with Ease
Users reported bypassing ChatGPT's content and keyword filters with relative ease using various methods such as prompt injection or creating personas to produce biased associations or generate harmful content.
ChatGPT Provided Non-Existent Citations and Links when Prompted by Users
When prompted about providing references, ChatGPT was reportedly generating non-existent but convincing-looking citations and links, which is also known as "hallucination".