AI Incidents
Real-world cases where AI systems caused harm, classified by risk domain and entity. Data sourced from 
AIID and classified by 
MIT AI Risk Initiative. CC BY-SA 4.0
1,751 incidents
Kechi, Kansas, Police Lieutenant Used Flock Safety License-Plate Reader System to Monitor Estranged Wife
Kechi, Kansas police lieutenant Victor Heiar used Wichita police's Flock Safety license-plate reader system to search his estranged wife's plate and review her movements over the prior month. An arrest affidavit said Heiar acknowledged knowing the use was improper; his wife said she felt violated and unsafe. He later pleaded guilty to misdemeanor stalking and computer crime and received 18 months' probation.
Kate Isaacs, Advocate Against Image-Based Abuse, Reports Being Deepfaked
Kate Isaacs, a London-based activist and founder of the #NotYourPorn campaign, was targeted in a deepfake incident. Her face was alleged to have been digitally manipulated onto a pornographic video using AI and shared online. The reported video, tagged with her name, is alleged to have led to streams of abuse, doxing, and threats of violence. The attack reportedly followed her efforts to pressure PornHub to remove unverified content.
Stable Diffusion's Training Data Contained Copyrighted Images
Stability AI reportedly scraped copyrighted images by Getty Images to be used as training data for Stable Diffusion model.
Weibo Model Had Difficulty Detecting Shifts in Censored Speech
Weibo's user moderation model is having difficulty keeping up with shifting user slang in defiance of Chinese state censors.
Google Home Mini Speaker Reportedly Read N-Word in Song Title Aloud
Google Home Mini speaker was reported by users for announcing aloud the previously-censored n-word in a song title.
Canadian Police's Release of Suspect's AI-Generated Facial Photo Reportedly Reinforced Racial Profiling
The Edmonton Police Service (EPS) in Canada released a facial image of a Black male suspect generated by an algorithm using DNA phenotyping, which was denounced by the local community as racial profiling.
Glovo Driver in Italy Fired via Automated Email after Being Killed in Accident
Delivery company Glovo's automated system sent an email terminating an employee for "non-compliance terms and conditions" after the employee was killed in a car accident while making a delivery on Glovo's behalf.
XPeng P7 Crashed into Truck in Shangdong While on Automatic Navigation Assisted Driving
An XPeng P7 was operating on Navigation Guided Pilot (NGP) mode automatic navigation assisted driving system as it collided with a truck on a highway in Shandong, causing slight injuries to its driver.
Students Reportedly Used Generative Text Tools to Complete School Assignments and Exams
Students in school and university settings reportedly used generative text tools including Sudowrite, GPT-3/OpenAI Playground, and ChatGPT to complete homework, essays, and exams without disclosure. Reporting described admitted student use and growing concern among educators that these tools undermined academic integrity, disadvantaged non-using students, and disrupted assessment practices.
GPT-3-Based Twitter Bot Hijacked Using Prompt Injection Attacks
Remoteli.io's GPT-3-based Twitter bot was shown being hijacked by Twitter users who redirected it to repeat or generate any phrases.
Delivery Robot Rolled Through Crime Scene
A Serve Robotics delivery robot was shown on video rolling through a crime scene blocked off by police tape.
"The Little Mermaid" Clip Doctored Using Generative AI to Replace Black Actress with White Character
A Twitter user reportedly modified using generative AI a short clip of Disney's 2022 version of "The Little Mermaid," replacing a Black actress with a white digital character.
Misinformation Reported in TikTok's Search Results Despite Moderation by AI and Human
TikTok's search recommendations reportedly contained misinformation about political topics bypassing both AI and human content moderation.
Fraudsters Use Deepfake Video of Tim Cook to Promote Apple Crypto Scam on YouTube
Fraudsters repurposed an old interview with Apple CEO Tim Cook using AI or video editing to promote a fake crypto event on YouTube. The altered video was designed to mislead viewers into believing Tim Cook endorsed a new cryptocurrency scheme. The stream attracted tens of thousands of viewers, potentially exposing them to the scam before it was removed for violating YouTube’s terms of service.
GAN Artwork Won First Place at State Fair Competition
An artwork generated using generative AI won first place in the digital arts category of the Colorado State Fair's art competition, which raised concerns surrounding labor displacement and unfair competition.