AI Incidents
Real-world cases where AI systems caused harm, classified by risk domain and entity. Data sourced from 
AIID and classified by 
MIT AI Risk Initiative. CC BY-SA 4.0
159 incidents
ChatGPT Allegedly Defamed Norwegian User by Inventing Child Homicide and Imprisonment
In August 2024, ChatGPT is reported to have falsely claimed that Norwegian citizen Arve Hjalmar Holmen had killed his two sons and been sentenced to 21 years in prison. The fabricated response allegedly included specific details about the supposed crime, despite Holmen never being accused or convicted of any offense. The incident prompted a GDPR complaint for defamation and inaccurate personal data.
Grok AI Chatbot Reportedly Spreads Unfounded Rumors About Trump’s Dentures
Grok, X’s AI-powered chatbot, reportedly spread unsubstantiated claims about former President Trump’s alleged dentures during his interview with Elon Musk. The AI-generated summary is alleged to have falsely stated that Trump’s speech issues were due to missing dentures, despite no evidence. The post was quickly removed, but the incident is an example of concerns over Grok's tendency to amplify misinformation.
AI-Generated Fake 'True Crime' Video About Non-Existent Littleton Murder Goes Viral
An AI-generated "true crime" video on YouTube falsely depicted a Littleton man's "secret gay love affair" and murder by his stepson. The 25-minute video, which garnered nearly 2 million views, fabricated details and used deepfake technology to deceive viewers into believing the story was real. Despite being flagged as false by local authorities and lacking credible sources, the video sparked widespread misinformation and outrage online.
SearchGPT Reportedly Misleads Users with Incorrect Festival Dates in Demo
OpenAI’s prototype AI tool, SearchGPT, provided incorrect dates for An Appalachian Summer Festival in Boone, North Carolina during a demonstration video. The AI listed dates that were incorrect, potentially misleading users planning to attend the event, but also harming the reputation of OpenAI as the incident occurred during a high-profile event.
AI Chatbots Reportedly Inaccurately Conveyed Real-Time Political News
Over a week of back-to-back, significant breaking political news stories, including the Trump rally shooting and Biden’s campaign withdrawal, AI chatbots reportedly failed to provide accurate real-time updates. Most chatbots gave incorrect or outdated information, demonstrating their current limitations in handling fast-paced news. These incidents suggest the continuing need for improved AI capabilities and caution in their deployment for real-time news dissemination.
False Election Data on Kamala Harris Reportedly Circulated via Grok AI Chatbot
After President Joe Biden stepped aside as a presidential candidate on July 21, 2024, the AI chatbot Grok on X reportedly falsely informed users that Vice President Kamala Harris missed the ballot deadline in nine states. This misinformation, which spread widely on social media, prompted secretaries of state from five U.S. states to urge Elon Musk to address the problem.
Grok AI Model Reportedly Fails to Produce Reliable News in Wake of Trump Assassination Attempt
xAI's model Grok, intended to automate news delivery on the X platform, is reported to have struggled to provide accurate information during the attempted assassination of former President Donald Trump. Grok apparently issued incorrect headlines, including false reports about Vice President Kamala Harris being shot and misidentifying the alleged shooter. These errors show the pitfalls of relying on AI for real-time news aggregation, as it allegedly amplified unverified claims and failed to recognize sarcasm, undermining its reliability.
AI-Generated Obituaries Are Reportedly Intensifying Grief for Bereaved Families
AI-generated obituaries on various websites are reported to have compounded the grief of bereaved families by spreading incorrect and unauthorized information about their loved ones. These obituaries, produced without the families' knowledge, often contain errors and appear on ad-filled sites, exacerbating the emotional distress of the grieving process.
AI Work Assistants Require More Effort Than Expected, CIOs Say
AI work assistants, such as Copilot for Microsoft 365 and Gemini for Google Workspace, are proving to be more labor-intensive than anticipated for enterprises. CIOs report that these AI tools struggle with outdated or inaccurate data, leading to incorrect outputs. Companies are finding they must invest heavily in data management to ensure reliability. This added effort has led to delays in deployment and frustration, as businesses work to maximize the potential of these expensive AI tools.
Erroneous Declined Transaction Notification by PayPal AI Assistant
On July 13th, 2024, a user reported an incident involving PayPal's generative AI chatbot. The chatbot allegedly incorrectly informed the user of a declined transaction that never occurred, causing confusion and prompting a call to customer service for clarification. This false alert suggests a flaw in the AI system's reliability. The incident created unnecessary labor for both the user and PayPal's human support, demonstrating the potential harm of deploying generative AI without thorough testing and error handling mechanisms.
Leading AI Models Reportedly Found to Mimic Russian Disinformation in 33% of Cases and to Cite Fake Moscow News Sites
An audit by NewsGuard revealed that leading chatbots, including ChatGPT-4, You.com’s Smart Assistant, and others, repeated Russian disinformation narratives in one-third of their responses. These narratives originated from a network of fake news sites created by John Mark Dougan (Incident 701). The audit tested 570 prompts across 10 AI chatbots, showing that AI remains a tool for spreading disinformation despite efforts to prevent misuse.
BNN Breaking's AI-Driven Errors Reportedly Damage Reputations and Spread Misinformation
BNN Breaking, an AI-driven news site, published a false story about Irish DJ Dave Fanning, damaging his reputation. The site used AI to generate error-filled content, leading to numerous complaints and a defamation lawsuit against BNN and Microsoft. The site has since gone dormant.
Reportedly Faulty AI Transcription Threatens Integrity of Genoa Bribery Probe
A reported AI transcription software error in a Genoa bribery investigation is alleged to have incorrectly recorded "illicit financing" instead of "licit financing," which could have significantly impacted the case. The mistake was discovered during a review and is an example of the risks of relying on AI in judicial settings.
Study Highlights Persistent Hallucinations in Legal AI Systems
Stanford University’s Human-Centered AI Institute (HAI) conducted a study in which they designed a "pre-registered dataset of over 200 open-ended legal queries" to test AI products by LexisNexis (creator of Lexis+ AI) and Thomson Reuters (creator of Westlaw AI-Assisted Research and Ask Practical Law AI). The researchers found that these legal models hallucinate in 1 out of 6 (or more) benchmarking queries.
Meta's AI Chatbots Are Reportedly Entering Online Support Communities Uninvited
Meta's AI chatbots have reportedly begun entering online communities on Facebook, providing responses that mimic human interaction. These chatbots, often uninvited, disrupt the human connection critical for support groups by giving misleading or false information and pretending to share lived experiences.