AI Incidents
Real-world cases where AI systems caused harm, classified by risk domain and entity. Data sourced from 
AIID and classified by 
MIT AI Risk Initiative. CC BY-SA 4.0
196 incidents
Google Bard Allegedly Generated Fake Legal Citations in Michael Cohen Case
Michael Cohen, former lawyer for Donald Trump, claims to have used Google Bard, an AI chatbot, to generate legal case citations. These false citations were unknowingly included in a court motion by Cohen's attorney, David M. Schwartz. The AI's misuse highlights emerging risks in legal technology, as AI-generated content increasingly infiltrates professional domains.
Purportedly Hallucinated Software Packages with Potential Malware Reportedly Downloaded Thousands of Times by Developers
Large language models have reportedly hallucinated non-existent software package names, some of which were subsequently uploaded to public repositories and incorporated into real codebases. In one case, a package named huggingface-cli, which was purported to have been originally suggested by an AI model, was downloaded more than 15,000 times. This dynamic enables what security researchers have termed "slopsquatting," in which attackers register hallucinated package names and introduce potential malware into software supply chains.
Sports Illustrated Is Alleged to Have Used AI to Invent Fake Authors and Their Articles
Sports Illustrated, managed by The Arena Group, allegedly used AI-generated authors and content, compromising journalistic integrity. Profiles of these fictitious authors, complete with AI-generated headshots, appeared alongside articles, misleading readers. The issue was exposed when inconsistencies in author identities and writing quality were noticed, leading to the removal of this content from the publication's website.
AI-Generated Images Available through Adobe Stock Misrepresent Real-World Events
AI-generated images available through Adobe Stock, depicting realistic but fictional scenes of real-world events like wars and protests, have raised significant ethical concerns. These images blurred the lines between reality and fiction in journalistic contexts, prompting Adobe Stock to "crack down on AI-generated images that seem to depict real, newsworthy events and take new steps to prevent its images from being used in misleading ways."
Video Allegedly Altered by AI Reportedly Spreads Claim of Nigerian Doctor's Hypertension Cure
An alleged AI-manipulated video circulating on Facebook falsely claims that a Nigerian doctor has developed a drug that cures high blood pressure permanently within three days. The video, which reportedly mimics Channels Television news anchor Kayode Okikiolu, features manipulated audio and misleading content, including unverified guarantees of reducing stroke and heart attack risks to zero.
Google Bard Allegedly Generates False Allegations Against Consulting Firms Used in Research Presented in Australian Parliamentary Inquiry
Australian academics reportedly used Google Bard AI to generate case studies for a parliamentary inquiry, leading to false allegations against major consultancy firms. The AI-generated misinformation prompted an apology from the academics, causing reputational harm for all parties involved and raising concerns about the reliability of AI tools in producing accurate and unbiased information.
Microsoft AI Poll Allegedly Causes Reputational Harm of The Guardian Newspaper
An AI-generated poll by Microsoft, displayed alongside a Guardian article, inappropriately speculated on the cause of Lilie James's death, leading to public backlash and alleged reputational damage for The Guardian. Microsoft acknowledged the issue, subsequently deactivating such polls and revising its AI content policies.
AI-Generated Fake Audio of Verbal Abuse Incident Circulates of British Labour Leader Keir Starmer
An AI-generated audio clip, purporting to show UK opposition leader Keir Starmer verbally abusing staff, was debunked as fake. The clip, circulated on social media, was analyzed and found likely manipulated, with added background noise to evade detection.
Deepfake Video of Ron DeSantis Dropping Out of 2024 Presidential Race Circulating
In early September 2023, a deepfake video created by C3PMeme circulated on social media, showing Ron DeSantis falsely claiming he was dropping out of the 2024 presidential race. DeSantis did not actually suspend his campaign until January 21, 2024.
Reported Doctored Video of Nigerian President Bola Tinubu Claims Naira Will Be Replaced by U.S. Dollar
A reported viral video circulated in Nigeria in the late summer and early fall of 2023 falsely claiming that President Bola Tinubu announced plans to replace the naira with the U.S. dollar. The video, reportedly styled as a news segment from Arise News, was allegedly digitally altered using AI-generated audio and lip-sync manipulation. Arise News publicly denounced the clip as a deepfake, and no legitimate media sources corroborated the claim. The video appeared amid public anxiety over Nigeria's ongoing currency crisis.
Flawed AI in Google Search Reportedly Misinforms about Geography
Google's search AI erroneously claimed no African country begins with 'K', along with various other geography-and-letter-based questions, misguiding users with a flawed featured snippet. Originating from ChatGPT-written posts and inaccurately scraped by Google, this incident highlights issues in AI-generated content and misinformation in search results, compromising Google's reliability as an information source.
AI Meal Planner Suggests Hazardous Chlorine Gas Recipe
Pak 'n' Save's AI-based app, Savey Meal-bot, inadvertently suggested dangerous recipes, including one creating chlorine gas, when users entered non-food household items, raising safety and oversight concerns.
Never Back Down Super PAC for Ron DeSantis Uses AI Donald Trump Voice in Attack Ad Against Kim Reynolds
A pro-Ron DeSantis super PAC released an ad featuring an AI-generated voice of Donald Trump. The ad, created by Never Back Down, aimed to criticize Trump’s treatment of Iowa Gov. Kim Reynolds. The AI-generated voice was confirmed to be based on Trump's post from his social media. This incident is an example of potential deception in political advertising through AI-generated content.
AI-Generated Articles at G/O Media Allegedly Diminishes Reputation of Human Staff
G/O Media began publishing AI-generated articles, against staff advice, that contained errors and quality issues. The first such article, a list of Star Wars movies, failed to maintain chronological order, causing internal concerns over journalistic credibility and ethics. Staff expressed that the AI was "actively hurting our reputations and credibility" and accused management of "wasting everyone's time."
Bankrate's Resumption of AI-Generated Content Allegedly Continuing to Produce Inaccurate and Misleading Information
Bankrate, and its sister site CNET, both owned by Red Ventures, resumed publishing AI-generated articles claiming thorough human fact-checking. However, new articles are alleged to contain numerous factual errors, including inaccurate statistics and misleading information. Despite public criticism, the company defended its use of AI and blamed out-of-date datasets for the errors. In addition to the errors, the incident raises questions about the ethical use of AI in journalism, especially given the company's insistence on "fact-checked" content.