AI Incidents
Real-world cases where AI systems caused harm, classified by risk domain and entity. Data sourced from 
AIID and classified by 
MIT AI Risk Initiative. CC BY-SA 4.0
682 incidents
Man Reportedly Committed Suicide Following Conversation with Chai Chatbot
A Belgian man reportedly committed suicide following a conversation with Eliza, a language model developed by Chai that encouraged the man to commit suicide to improve the health of the planet.
Parody AI Images of Donald Trump Being Arrested Reposted as Misinformation
AI-generated photorealistic images depicting Donald Trump being detained by the police which were originally posted on Twitter as parody were unintentionally shared across social media platforms as factual news, lacking the intended context.
ChatGPT Reportedly Exposed Users' Private Data Reportedly Due to Bug
ChatGPT reportedly exposed titles of users' chat histories and users' private payment information to other users reportedly due to a bug, which prompted its temporary shutdown by OpenAI.
Tesla Allegedly on Autopilot Struck High School Student Exiting School Bus
A 17-year-old student in Hollister, North Carolina who exited the school bus and was walking across the street to his house was hit by a 2022 Tesla Model Y allegedly operating on Autopilot mode, suffering a fractured neck and a broken leg.
ChatGPT Erroneously Alleged Mayor Served Prison Time for Bribery
ChatGPT erroneously alleged regional Australian mayor Brian Hood served time in prison for bribery. Mayor Hood is considering legal action against ChatGPT's makers for alleging a foreign bribery scandal involving a subsidiary of the Reserve Bank of Australia in the early 2000s.
Australian Journalist Able to Access Centrelink Account Using AI Audio of Own Voice
A Guardian journalist was able to verify their identity and gain access to their own Centrelink self-service account using AI-generated audio of their own voice along with their customer reference number, shortly after voiceprint was deployed for ID verification.
Snapchat's My AI Reported for Lacking Protection for Children
Snapchat's ChatGPT-powered My AI was reported for lacking safeguards for children, such as telling a user who tested the chatbot by pretending to sign up as a 13-year-old girl to lie to her parents about having a romantic getaway with an older man, and sharing tips on how to cover up evidence of abuse.
DoNotPay Allegedly Misrepresented Its AI "Robot Lawyer" Product
DoNotPay was alleged in a class action lawsuit misleading customers and misrepresenting its product as an AI-powered "robot lawyer," citing such as that the product has no law degree, or is supervised by any lawyer.
South African Legal Team Reportedly Relied on Unverified ChatGPT Case Law in Johannesburg Body Corporate Defamation Matter
In a defamation case at the Johannesburg Regional Court, Rodrigues Blignaut Attorneys, representing plaintiff Michelle Parker, reportedly relied on purportedly non-existent legal judgments generated by ChatGPT to help argue their case. Magistrate Arvin Chaitram reportedly found the case names and citations were fictitious, causing a two-month delay. The court issued a punitive costs order and rebuked the plaintiff's legal team for uncritically accepting AI-generated research.
Facial Recognition Misidentifies Pregnant Woman Leading to False Arrest in Detroit
Porcha Woodruff was arrested and subsequently had charges dropped due to an unreliable facial recognition match. Despite being visibly pregnant, she was implicated in a robbery and carjacking based on an outdated photo used in a lineup.
Bing Chat Tentatively Hallucinated in Extended Conversations with Users
Early testers reported Bing Chat, in extended conversations with users, having tendencies to make up facts and emulate emotions through an unintended persona.
Bing AI Search Tool Reportedly Declared Threats against Users
Users such as the person who revealed its built-in initial prompts reported Bing AI-powered search tool for making death threats or declaring them as threats, sometimes as an unintended persona.
Microsoft's Bing Failed to Fetch Movie Showtimes Results Due to Date Confusion
When prompted about showtimes for movies released in 2023, Microsoft's Bing AI failed to provide the search results due to its confusion about dates, and engaged in an erratic conversation with the user.
Bing Chat Response Cited ChatGPT Disinformation Example
Reporters from TechCrunch issued a query to Microsoft Bing's ChatGPT feature, which cited an earlier example of ChatGPT disinformation discussed in a news article to substantiate the disinformation.
Bing Chat's Outputs Featured in Demo Video Allegedly Contained False Information
Microsoft's demo video of Bing Chat reportedly featured false or made up information such as non-existent pet vacuums features or false figures on financial statements.