AI Incidents
Real-world cases where AI systems caused harm, classified by risk domain and entity. Data sourced from
AIID and classified by MIT AI Risk Initiative. CC BY-SA 4.0
538 incidents
GAN Faces Deployed by The BL's Fake Account Network to Push Pro-Trump Content on Meta Platforms
A large network of pages, groups, and fake accounts having GAN-generated face photos associated with The BL, a US-based media outlet, reportedly bypassed Facebook moderation systems to push "pro-Trump" narratives on its platform and Instagram.
Telegram Channels Allowed Users to Make Non-Consensual Deepfake Porn as Paid Service
Seven channels were connected in a Telegram ecosystem centered around letting subscribers, as a paid service, generate non-consensual deepfake nudes using a bot from submitted photos of women, including underage girls and women who they know in real life.
Fraudsters Used AI to Mimic Voice of a UK-Based Firm's CEO's Boss
Fraudsters allegedly used AI voice technology to impersonate the boss of a UK-based firm's CEO, demanding a transfer of €220,000 over the phone.
Two Investment Firms Charged with Making False Claims of Artificial Intelligence Capabilities in Case of AI Washing
In a case of AI washing, the SEC charged two investment advisers, Delphia and Global Predictions, for falsely stating their use of artificial intelligence in their investment strategies between 2019 and 2023. Their misleading claims resulted in a settlement whereby the firms agreed to pay a total of $400,000 in penalties, highlighting the critical consequences of misrepresenting AI capabilities on investment decisions and trust.
Investigative Journalist Rana Ayyub Targeted by AI-Generated Deepfake Pornography
Investigative journalist Rana Ayyub was targeted by a deepfake porn campaign, where AI-generated explicit content falsely depicted her in a pornographic video. This was part of a broader effort to discredit and silence her, which included a doxxing attack that exposed her personal information that resulted in severe harassment and emotional distress.
'Jewish Baby Strollers' Provided Antisemitic Google Images, Allegedly Resulting from Hate Speech Campaign
Results for Google Images searches for "Jewish baby strollers" reportedly showed offensive, antisemitic results, allegedly a result of a coordinated hate-speech campaign involving malicious actors on 4chan.
Male College Freshman Allegedly Made Porn Deepfakes Using Female Friend's Face
A female college student's face was superimposed on another woman's body in deepfake pornographic videos and shared on 4chan allegedly by a male student whose friendship with her fell apart during freshman year.
RealPage's YieldStar Allegedly Facilitated Rent Price Coordination Among Canadian Landlords
RealPage’s YieldStar algorithm is alleged to have enabled Canadian landlords to coordinate rental pricing by utilizing sensitive, non-public market data. The software has been accused of contributing to rent increases in non-rent-controlled units through purported collusion and artificial price inflation. Tenants have reported significant rent hikes, which they attribute to landlords' use of the algorithm.
Government Deployed Extreme Surveillance Technologies to Monitor and Target Muslim Minorities in Xinjiang
A suite of AI-powered digital surveillance systems involving facial recognition and analysis of biometric data were deployed by the Chinese government in Xinjiang to monitor and discriminate local Uyghur and other Turkic Muslims.
Facebook Ad-Approval Algorithm Allegedly Missed Fraudulent Ads via Simple URL Checks
Facebook’s advertisement-approval algorithm was reported by a security analyst to have neglected simple checks for domain URLs, leaving its users at risk of fraudulent ads.
Facial Recognition Service Abused to Target Russian Porn Actresses
The facial recognition software FindFace allowing its users to match photos to people’s social media pages on Vkontakte was reportedly abused to de-anonymize and harass Russian women who appeared in pornography and alleged sex workers.
Uber Deployed Secret Program To Deny Local Authorities Rides
Uber developed a secret program "Greyball" which prevented known law enforcement officers in areas where its service violated regulations from receiving rides.
2010 Market Flash Crash
A modified algorithm was able to cause dramatic price volatility and disrupted trading in the US stock exchange.