AI Incidents
Real-world cases where AI systems caused harm, classified by risk domain and entity. Data sourced from
AIID and classified by MIT AI Risk Initiative. CC BY-SA 4.0
1,751 incidents
Instagram Algorithms Allegedly Promote Accounts Facilitating Child Sex Abuse Content
An investigation disclosed that Instagram's recommendation algorithms are promoting accounts that facilitate and sell child sexual abuse material (CSAM). The study, conducted by The Wall Street Journal and researchers at Stanford University and the University of Massachusetts Amherst, indicates that Instagram's algorithms not only allow for the discovery of such accounts through keyword searches but also actively recommend them to users within the network. The issue is especially concerning given Instagram's popularity among teenagers.
Ron DeSantis's Presidential Campaign Released Twitter Video Containing AI Images of Donald Trump Hugging Anthony Fauci
Ron DeSantis’s presidential campaign shared a video on Twitter featuring some AI-generated images of Donald Trump hugging former White House coronavirus advisor Anthony Fauci, allegedly as a smear campaign. This incident is possibly the first time a major U.S. presidential campaign deployed deepfakes with the intention of misleading the electorate.
Former Costa Mesa, California, Police Officer Reportedly Used Flock Safety License-Plate Reader System to Track Woman He Was Seeing and Her Romantic Partners
Orange County prosecutors said Costa Mesa, California, police officer Robert Jay Josett used the department's Flock Safety license-plate reader system between 2023 and 2024 to locate a woman he was seeing and vehicles belonging to her romantic partners, including after he was placed on leave. In 2026, Josett pleaded guilty to misdemeanor unauthorized computer access and fraud, repeated phone calls, and contempt of court.
AI-Generated Voices Amplify Conspiracy Theories on TikTok
NewsGuard has identified 17 TikTok accounts that have been using AI-generated voices to advance and amplify conspiracy theories and false claims beginning in June 2023. By September 25, 2023, these accounts had amassed over 336 million views and over 14.5 million likes. Videos include baseless claims involving public figures such as Barack Obama, Oprah Winfrey, and Jamie Foxx.
Racial Bias in Lung Function Diagnostic Algorithm Leads to Underdiagnosis in Black Men
A study published in JAMA Network Open reveals that racial bias built into a commonly used medical diagnostic algorithm for lung function may be leading to underdiagnoses of breathing problems in Black men. The study suggests that as many as 40% more Black male patients might have been accurately diagnosed if the software were not racially biased. The software algorithm adjusts diagnostic thresholds based on race, affecting medical treatments and interventions.
Chatbot Tessa gives unauthorized diet advice to users seeking help for eating disorders
The National Eating Disorders Association (NEDA) has shut down its chatbot named Tessa after it gave weight-loss advice to users seeking help for eating disorders. The incident has raised concerns about the risks of using chatbots and AI assistants in healthcare settings, particularly in addressing sensitive issues like eating disorders. NEDA is investigating the matter, emphasizing the need for caution and accuracy when utilizing technology to provide mental health support.
Unrepresented Litigant Misled by ChatGPT-Generated False Legal Citations in Manchester Court
A litigant in person (LiP) in a Manchester civil case presented false legal citations generated by ChatGPT. It fabricated one case name and provided fictitious excerpts for three real cases, misleadingly supporting the LiP's argument. The judge, upon investigation, found the submissions to be inadvertent and did not penalize the LiP.
Opera's GPT-Based AI Reportedly Accused War Photographers of War Crimes
When prompted about "photographers accused of committing war crimes," Opera's GPT-based chatbot Aria provided a list of photographers who take photography of military conflicts.
Donald Trump's Presidential Campaign Released Deepfakes Attacking Ron DeSantis
Former President Donald Trump released two AI-generated videos using deepfaked voices to mock Florida Governor Ron DeSantis. The first video, posted on platforms like Rumble and Instagram, depicted a chaotic and offensive fake Twitter Spaces event featuring deepfaked voices of Elon Musk, George Soros, Klaus Schwab, Dick Cheney, Adolf Hitler, and a generated voice of Satan. The second video showed a rocket with "Ron 2024" written beside it falling and exploding before liftoff.
Purported AI-Generated Image of Explosion Near Pentagon Reportedly Triggers Brief Market Dip and Public Confusion
A Twitter/X account allegedly impersonating Bloomberg reportedly posted an image falsely showing an explosion near the Pentagon. Analysts reportedly described the image as likely AI-generated. The post reportedly spread through major accounts before officials confirmed no incident occurred. Markets reportedly dipped during the short period when the hoax circulated.
FTC Targets Edmodo for Unlawful Use of Children’s Data and Delegating Compliance to Schools
Edmodo, an education technology provider, violated the Children's Online Privacy Protection Act Rule (COPPA Rule) by collecting and using children's personal data for advertising purposes without parental consent, according to the FTC. The company outsourced its compliance responsibilities to schools, thereby making them "solely" responsible for COPPA compliance without adequate disclosure. Edmodo is facing a proposed order prohibiting such practices, marking a precedent in the ed tech industry.
Apparent Failure to Accurately Label Primates in Image Recognition Software Due to Alleged Fear of Racial Bias
Eight years after Google Photos mislabeled images of Black individuals as "gorillas," image recognition software by Google, Apple, Amazon, and Microsoft still shows signs of either avoiding or inaccurately categorizing primates. Tests reveal that Google and Apple Photos refrain from labeling primates altogether, possibly to avoid the risk of perpetuating racial stereotypes. Microsoft OneDrive fails to identify any animals, while Amazon Photos overgeneralizes in its labeling.
Google Results for Johannes Vermeer Featured AI Version of His Artwork as Top Result
Google's search engine featured an AI-generated hyperrealistic version of the painting "Girl With a Pearl Earring" as the highlighted result when users search for its Dutch artist Johannes Vermeer.
AI-Enabled TruDi Navigation System Was Alleged to Have Contributed to Patient's Stroke During May 2023 Sinuplasty
Patient Donna Fernihough allegedly suffered carotid-artery damage and a same-day stroke during a May 19, 2023 balloon sinuplasty in Texas in which surgeon Marc Dean reportedly used Acclarent's AI-enabled TruDi Navigation System. Her lawsuit alleged the system's AI-assisted navigation contributed to unsafe guidance during the procedure; Acclarent and Integra LifeSciences, which later acquired Acclarent, denied evidence linking TruDi's AI to the injuries.
Illinois Residents File Class Action Lawsuit Against Facial Recognition Technology Companies for Allegedly Violating BIPA
A class action lawsuit was filed against several facial recognition technology companies for allegedly violating the Illinois Biometric Information Privacy Act (BIPA). The defendants are accused of offering a facial recognition search engine called Pimeyes, which collects images from databases across the internet and scans them into their database seemingly without consent. This action is claimed to invade the privacy of millions of Americans. The lawsuit argues that Pimeyes lacks publicly available policies regarding data storage and deletion, in contravention of BIPA's requirements for informed written consent before collecting biometric data.
Statistics
Risk Taxonomy
Caused By
Year Trend
* Oct 2026, ~320 projected
AIID · MIT AIRI · CC BY-SA 4.0