AI Incidents
Real-world cases where AI systems caused harm, classified by risk domain and entity. Data sourced from 
AIID and classified by 
MIT AI Risk Initiative. CC BY-SA 4.0
217 incidents
Google Instant's Allegedly 'Anti-Semitic' Results Lead To Lawsuit In France
The organizations SOS Racisme, Union of Jewish Students of France, Movement Against Racism and for Friendship Among Peoples are suing Google due to its autocomplete software suggesting "jewish" when the names of certain public figures were searched on the platform.
Major Universities Are Reportedly Using Race as a 'High Impact Predictor' of Student Success
Several major universities are reportedly using a tool that uses race as one factor to predict student success.
IRS Audited Black Taxpayers More Frequently Reportedly Due to Algorithm
The IRS was auditing Black taxpayers more frequently than other groups allegedly due to the design of their algorithms, focusing on easier-to-conduct audits which inadvertently correlated with the group's pattern of tax filing errors.
Automated Adult Content Detection Tools Showed Bias against Women Bodies
Automated content moderation tools to detect sexual explicitness or "raciness" reportedly exhibited bias against women bodies, resulting in suppression of reach despite not breaking platform policies.
Virginia Courts’ Algorithmic Recidivism Risk Assessment Failed to Lower Incarceration Rates
Virginia courts’ use of algorithmic predictions of future offending risks were found by researchers failing to reduce incarceration rates, showed racial and age disparities in risk scores and its application, and neither exacerbated or ameliorated historical racial differences in sentencing.
Kidney Testing Method Allegedly Underestimated Risk of Black Patients
Decades-long use of the estimated glomerular filtration rate (eGFR) method to test kidney function which considers race has been criticized by physicians and medical students for its racist history and inaccuracy against Black patients.
St George's Hospital Medical School allegedly Automated Admissions with Discriminatory Results
From 1982 to 1986, St George's Hospital Medical School used a program to automate a portion of their admissions process that allegedly discriminated against women and members of ethnic minorities.