AI Incidents
Real-world cases where AI systems caused harm, classified by risk domain and entity. Data sourced from
AIID and classified by MIT AI Risk Initiative. CC BY-SA 4.0
682 incidents
Virginia Courts’ Algorithmic Recidivism Risk Assessment Failed to Lower Incarceration Rates
Virginia courts’ use of algorithmic predictions of future offending risks were found by researchers failing to reduce incarceration rates, showed racial and age disparities in risk scores and its application, and neither exacerbated or ameliorated historical racial differences in sentencing.
Patriot Missile System Misclassified US Navy Aircraft, Killing Pilot Upon Approval to Fire
US Navy's Patriot missile system misidentified an American Navy F/A-18C Hornet as an enemy projectile, prompting an operator to fire two missiles at the aircraft, which killed the pilot.
US Air Force's Patriot Missile Mistakenly Launched at Ally Fighter Jet, Killing Two
Acting on the recommendation of their Patriot missile system, American Air Force mistakenly launched the missile at an ally UK Tornado fighter jet, which killed two crew members on board.
Kidney Testing Method Allegedly Underestimated Risk of Black Patients
Decades-long use of the estimated glomerular filtration rate (eGFR) method to test kidney function which considers race has been criticized by physicians and medical students for its racist history and inaccuracy against Black patients.
St George's Hospital Medical School allegedly Automated Admissions with Discriminatory Results
From 1982 to 1986, St George's Hospital Medical School used a program to automate a portion of their admissions process that allegedly discriminated against women and members of ethnic minorities.
Error in Pepsi's Number Generation System Led to Decades-Long Damages in the Philippines
Pepsi's number generation system determining daily winners in its Number Fever promotion in the Philippines mistakenly produced a number held by thousands which resulted in riots, deaths, conspiracy theories, and decades of lawsuits.
Nuclear False Alarm
An alert of five incoming intercontinental ballistic missiles was properly identified as a false-positive by the Soviet Union operator Stanislov Petrov.