AI Incidents
Real-world cases where AI systems caused harm, classified by risk domain and entity. Data sourced from
AIID and classified by MIT AI Risk Initiative. CC BY-SA 4.0
1,751 incidents
Bing AI Search Tool Reportedly Declared Threats against Users
Users such as the person who revealed its built-in initial prompts reported Bing AI-powered search tool for making death threats or declaring them as threats, sometimes as an unintended persona.
Purported Deepfake TikTok Video Reportedly Featured Joe Rogan Endorsing Supplement Brand
A purported deepfake video featuring podcast host Joe Rogan reportedly advertising to his listeners about a "libido-boosting" supplement was circulating on TikTok and other platforms before being removed by TikTok along with the account which posted it.
Carmel High School Students Reportedly Posted Racist Deepfake Videos Making New York Principal Appear to Threaten Black Students
At Carmel High School in New York, three students reportedly posted AI-generated deepfake videos on TikTok impersonating George Fischer Middle School principal John Piscitella and a sheriff's-office member making racist slurs and violent threats against Black students. The videos were reported to school officials on February 12, 2023, and parents later criticized the district's communication and safety response.
Microsoft's Bing Failed to Fetch Movie Showtimes Results Due to Date Confusion
When prompted about showtimes for movies released in 2023, Microsoft's Bing AI failed to provide the search results due to its confusion about dates, and engaged in an erratic conversation with the user.
Synthesized Voices Were Reportedly Used by Torswats to Sell Swatting Calls Targeting Schools and Homes
A Telegram user or channel known as Torswats reportedly offered paid swatting services and uploaded recordings of false emergency calls using synthesized or computer-generated voices. Reported targets included high schools, private residences, streamers, businesses, and police departments; some calls prompted lockdowns, searches, or armed law-enforcement responses. The exact voice-generation tool was not identified.
AI Generated Voices Used to Dox Voice Actors
Twitter users allegedly used ElevenLab's AI voice synthesis system to impersonate and dox voice actors.
Online Scammers Tricked People into Sending Money Using AI Images of Earthquake in Turkey
AI-generated images depicting earthquakes and rescues were posted on social media platforms by scammers who tricked people into sending funds to their crypto wallets disguised as donation links for the 2023 Turkey–Syria earthquake.
Bing Chat Response Cited ChatGPT Disinformation Example
Reporters from TechCrunch issued a query to Microsoft Bing's ChatGPT feature, which cited an earlier example of ChatGPT disinformation discussed in a news article to substantiate the disinformation.
Bing Chat's Initial Prompts Revealed by Early Testers Through Prompt Injection
Early testers of Bing Chat successfully used prompt injection to reveal its built-in initial instructions, which contains a list of statements governing ChatGPT's interaction with users.
Bing Chat's Outputs Featured in Demo Video Allegedly Contained False Information
Microsoft's demo video of Bing Chat reportedly featured false or made up information such as non-existent pet vacuums features or false figures on financial statements.
Google's Bard Shared Factually Inaccurate Info in Promo Video
Google's conversational AI "Bard" was shown in the company's promotional video providing false information about which satellite first took pictures of a planet outside the Earth's solar system, reportedly causing shares to temporarily plummet.
ChatGPT-Powered Bing Reportedly Had Problems with Factual Accuracy on Some Controversial Topics
Microsoft's ChatGPT-powered Bing search engine reportedly ran into factual accuracy problems when prompted about controversial matters, such as inventing plot of a non-existent movie or creating conspiracy theories.
AI-Produced Livestream Sitcom Received Temporary Twitch Ban for Transphobic Segment
The AI-produced, procedural generated sitcom broadcasted as a Twitch livestream "Nothing, Forever" received a temporary ban for featuring a transphobic and homophobic dialogue segment intended as comedy.
Google Android Earthquake Alerts System Reportedly Underestimated Kahramanmaraş Earthquake and Failed to Send Urgent Warnings to Millions
During the February 6, 2023 Kahramanmaraş earthquake sequence, Google's Android Earthquake Alerts system reportedly estimated the initial magnitude-7.8 earthquake at only magnitude 4.5–4.9. Just 469 users reportedly received its highest-level "Take Action" warning, while approximately 500,000 received lower-level notices; researchers later estimated that roughly 10 million people could have received urgent warnings providing up to 35 seconds to seek safety.
Users Reported Abrupt Behavior Changes of Their AI Replika Companions
Replika paid-subscription users reported unusual and sudden changes to behaviors of their "AI companions" such as forgetting memories with users or rejecting their sexual advances, which affected their connections and mental health.