AI Incidents
Real-world cases where AI systems caused harm, classified by risk domain and entity. Data sourced from 
AIID and classified by 
MIT AI Risk Initiative. CC BY-SA 4.0
196 incidents
AI-Generated Obituaries Are Reportedly Intensifying Grief for Bereaved Families
AI-generated obituaries on various websites are reported to have compounded the grief of bereaved families by spreading incorrect and unauthorized information about their loved ones. These obituaries, produced without the families' knowledge, often contain errors and appear on ad-filled sites, exacerbating the emotional distress of the grieving process.
Cody Enterprise Reporter Resigns After Admitting to AI-Generated Fake Quotes
A reporter at the Cody Enterprise used AI to generate fake quotes and stories, including fabricating statements from Wyoming’s governor and other officials. The misuse of AI was uncovered when another journalist noticed robotic phrases and false information in the articles. The reporter resigned, and the newspaper is now implementing policies to prevent future incidents.
AI Work Assistants Require More Effort Than Expected, CIOs Say
AI work assistants, such as Copilot for Microsoft 365 and Gemini for Google Workspace, are proving to be more labor-intensive than anticipated for enterprises. CIOs report that these AI tools struggle with outdated or inaccurate data, leading to incorrect outputs. Companies are finding they must invest heavily in data management to ensure reliability. This added effort has led to delays in deployment and frustration, as businesses work to maximize the potential of these expensive AI tools.
Erroneous Declined Transaction Notification by PayPal AI Assistant
On July 13th, 2024, a user reported an incident involving PayPal's generative AI chatbot. The chatbot allegedly incorrectly informed the user of a declined transaction that never occurred, causing confusion and prompting a call to customer service for clarification. This false alert suggests a flaw in the AI system's reliability. The incident created unnecessary labor for both the user and PayPal's human support, demonstrating the potential harm of deploying generative AI without thorough testing and error handling mechanisms.
Leading AI Models Reportedly Found to Mimic Russian Disinformation in 33% of Cases and to Cite Fake Moscow News Sites
An audit by NewsGuard revealed that leading chatbots, including ChatGPT-4, You.com’s Smart Assistant, and others, repeated Russian disinformation narratives in one-third of their responses. These narratives originated from a network of fake news sites created by John Mark Dougan (Incident 701). The audit tested 570 prompts across 10 AI chatbots, showing that AI remains a tool for spreading disinformation despite efforts to prevent misuse.
BNN Breaking's AI-Driven Errors Reportedly Damage Reputations and Spread Misinformation
BNN Breaking, an AI-driven news site, published a false story about Irish DJ Dave Fanning, damaging his reputation. The site used AI to generate error-filled content, leading to numerous complaints and a defamation lawsuit against BNN and Microsoft. The site has since gone dormant.
Hoodline Accused of Misleadingly Attributing AI-Generated Articles to Human Authors
In 2023, the news site Hoodline is reported to have begun publishing AI-generated articles with fake bylines, headshots, and biographies, allegedly misleading readers into believing they were authored by real journalists. This practice diminishes public trust and exemplifies the potential dangers of AI in journalism. Despite a disclaimer, the use of AI was not transparent.
Reportedly Faulty AI Transcription Threatens Integrity of Genoa Bribery Probe
A reported AI transcription software error in a Genoa bribery investigation is alleged to have incorrectly recorded "illicit financing" instead of "licit financing," which could have significantly impacted the case. The mistake was discovered during a review and is an example of the risks of relying on AI in judicial settings.
Study Highlights Persistent Hallucinations in Legal AI Systems
Stanford University’s Human-Centered AI Institute (HAI) conducted a study in which they designed a "pre-registered dataset of over 200 open-ended legal queries" to test AI products by LexisNexis (creator of Lexis+ AI) and Thomson Reuters (creator of Westlaw AI-Assisted Research and Ask Practical Law AI). The researchers found that these legal models hallucinate in 1 out of 6 (or more) benchmarking queries.
Meta's AI Chatbots Are Reportedly Entering Online Support Communities Uninvited
Meta's AI chatbots have reportedly begun entering online communities on Facebook, providing responses that mimic human interaction. These chatbots, often uninvited, disrupt the human connection critical for support groups by giving misleading or false information and pretending to share lived experiences.
Google AI Reportedly Delivering Confidently Incorrect and Harmful Information
Google's AI search engine has reportedly been providing users with confidently incorrect and often harmful information. Reports highlight numerous inaccuracies, including misleading health advice and dangerous cooking suggestions. For example, it has falsely claimed Barack Obama as the first Muslim U.S. President, reflecting fringe conspiracy theories, or recommending that glue can be an ingredient in pizza.
Facebook's Algorithm Reportedly Amplifies AI-Generated Content, Fueling Misleading Posts
AI-generated spam images are increasingly filling Facebook feeds, with the platform’s algorithm reportedly amplifying these posts. Many of these images are bizarre, fake, and used in scams, misleading users into engaging with non-existent products or clickbait.
Purported AI-Generated Deepfake Images of Katy Perry at 2024 Met Gala Circulate Widely
Purported AI-generated images depicting Katy Perry attending the 2024 Met Gala circulated widely on social media, leading to public confusion about her presence at the event. The images were realistic enough to deceive fans and even Perry’s mother, who believed them to be authentic. Perry publicly clarified the images were fake, attributing them to AI and noting she had missed the event due to work.
Purported ChatGPT Factual Errors Reportedly Led to Filing of Complaint of GDPR Privacy Violation
The activist organization noyb, founded by Max Schrems, reportedly filed a complaint in Europe against OpenAI alleging that ChatGPT violates the General Data Protection Regulation (GDPR) by providing inaccurate personal information such as birthdates about individuals.
Meta AI Hallucinates Harassment Allegations Against New York Politicians
Meta's AI chatbot in Facebook Messenger falsely accused multiple state lawmakers of sexual harassment, fabricating incidents, investigations, and consequences that never occurred. These fabricated stories, discovered by City & State, sparked outrage among the affected lawmakers and raised concerns about the reliability of the chatbot. Meta acknowledged the errors and committed to ongoing improvements.