AI Incidents
Real-world cases where AI systems caused harm, classified by risk domain and entity. Data sourced from 
AIID and classified by 
MIT AI Risk Initiative. CC BY-SA 4.0
961 incidents
ProKYC Tool Allegedly Facilitates Deepfake-Based Account Fraud on Cryptocurrency Exchanges
Cato CTRL security researchers reported that the cybercriminal group ProKYC is selling a deepfake tool capable of bypassing biometric and two-factor authentication (2FA) systems on cryptocurrency exchanges. The tool creates synthetic identities using AI-generated videos and forged documents, enabling fraudulent account creation. A demo video from ProKYC shows the tool in action against ByBit, allowing attackers to verify fake accounts for purposes such as money laundering and identity theft.
AI News Site Hoodline San Jose Erroneously Misidentifies San Mateo District Attorney as Murder Suspect
An AI-powered news site, Hoodline San Jose, falsely reported that the San Mateo County District Attorney had been charged with murder, which was an error resulting from misinterpreting a press release about a case the DA's office was prosecuting. The AI-generated article wrongly attributed the crime to the DA instead of the actual suspect.
Purportedly AI-Driven Phishing Scam Uses Spoofed Google Call to Attempt Gmail Breach of Security Expert
Scammers allegedly used a purportedly AI-generated voice to impersonate a Google representative in an attempt to steal Gmail account credentials from security expert Sam Mitrovic. The reportedly AI-driven phishing call used a spoofed Google phone number and a fabricated email, making the scam appear legitimate. Mitrovic reportedly noted that the caller's professional demeanor, coupled with AI-generated speech and a Google-related number, could easily deceive unsuspecting users.
AI-Powered Transcription Services Allegedly Leak Confidential Workplace Discussions
AI-powered meeting assistants, such as Otter.ai's OtterPilot and Zoom's AI Companion, have reportedly shared sensitive and private conversations beyond the intended audience. These tools, which are set to automatically record and distribute meeting transcripts, allegedly sent confidential discussions after participants had left the meeting, the consequences of which led to unintended exposure of proprietary information and privacy breaches.
Purportedly AI-Manipulated Video Allegedly Targets Moldovan Economic Development Minister Dumitru Alaiba in Election Disinformation Campaign
A purportedly AI-manipulated video and some photos circulated online depicting Moldova's Economic Development Minister, Dumitru Alaiba, in compromising situations as part of an alleged disinformation campaign by pro-Kremlin supporters, one that has been reported to rely on AI to generate fake content. Alaiba reportedly denounced the purported synthetic media as having been released to mislead the public and influence Moldova's elections by undermining his reputation and the government's pro-European Union stance.
Waymo Driverless Taxi Allegedly Stalled During Pedestrian Harassment Incident in San Francisco
A Waymo driverless taxi carrying a passenger, Amina V., was stalled in San Francisco when two men blocked its path, demanding her contact information. The immobilized autonomous vehicle left the rider feeling unsafe and trapped. Waymo’s Rider Support intervened to assist the passenger.
Purportedly AI-Generated Images Reportedly Spread Misinformation During Hurricane Helene Response
During Hurricane Helene (September 24-29, 2024), purportedly AI-generated images circulated on social media, reportedly misleading the public and hindering disaster response efforts. Reportedly fake images including animals stranded on rooftops and political figures in floodwaters added confusion and disrupted emergency management. The spread of these images allegedly exacerbated existing challenges, including power outages and communication failures, all of which led to complications providing accurate information to those in need.
Reported False Legal Citations in South African Case Mavundla v. MEC Generated by Purported AI Tool
In Mavundla v. MEC: Department of Co-Operative Government and Traditional Affairs KwaZulu-Natal, the law firm Surendra Singh and Associates, representing South African politician Philani Godfrey Mavundla, reportedly submitted false legal citations, apparently generated by AI, in filings at the Pietermaritzburg High Court. The court reportedly found that many of the cited cases did not exist in any databases, and the firm's legal team and article clerk allegedly failed to verify the references.
Senator Ben Cardin Reportedly Received a Purported Deepfake Zoom Call Impersonating Former Ukrainian Foreign Minister Dmytro Kuleba
Senator Ben Cardin was reportedly targeted with a purported deepfake on a Zoom call that appeared to imitate former Ukrainian Foreign Minister Dmytro Kuleba. The allegedly AI-generated video reproduced his likeness and voice but drew attention when the caller asked unusual questions.
Starship Technologies Delivery Robot Reportedly Injures Arizona State University Employee
A semi-autonomous delivery robot operated by Starship Technologies reportedly struck a pedestrian employed by Arizona State University on the campus sometime in September 2023, purportedly causing injuries after abruptly reversing into her. The robot is reported to have initially knocked the pedestrian down, then moved toward her again while she was still on the ground. The company reportedly offered the victim promo codes and insurance information as an apology. On September 19, 2024, 404 Media made the police report of the incident available.
AI-Generated Media Reportedly Used in Russian Disinformation Campaign in Moldova
Russian-linked entities allegedly deployed AI-generated images and videos to spread disinformation aimed at swaying Moldova’s referendum on E.U. membership. The AI-enhanced media campaign included fabricated stories and doctored visuals, the purpose of which was reportedly designed to amplify fear and undermine pro-E.U. sentiment in the days leading up to the referendum.
Purportedly AI-Generated Audio Allegedly Fabricates Biden's Admission of Role in Pakistani Political Crisis
A purported deepfake audio file is alleged to have falsely claimed that U.S. President Joe Biden conspired with Pakistan's Army Chief, General Syed Asim Munir, to remove former Prime Minister Imran Khan in 2022. Widely shared online, the audio is reported to have exploited generative AI to spread political misinformation.
Purported Deepfake of Brian May Allegedly Exploited in Scam Offering Fake Queen Backstage Tickets
Scammers allegedly created an AI-generated deepfake of Queen guitarist Brian May, reportedly posting a video on TikTok in which the fake May offers backstage tickets to a Queen concert. The real Brian May reportedly warned fans about this "disgusting" scam, emphasizing that Queen has no tour dates planned and does not sell backstage access.
Google AI Error Prompts Parents to Use Fecal Matter in Child Training Exercise
Google's AI Overview feature mistakenly advised parents to use human feces in a potty training exercise, misinterpreting a method that uses shaving cream or peanut butter as a substitute. This incident is another example of an AI failure in grasping contextual nuances that can lead to potentially harmful, and in this case unsanitary, recommendations. Google has acknowledged the error.
ESPN's AI Coverage Reportedly Overlooks Alex Morgan in Her Final Match Recap
ESPN's AI-generated recap of Alex Morgan's final professional soccer match reportedly failed to mention her significant retirement moment, instead providing a standard rundown that missed the emotional context.