AI Incidents
Real-world cases where AI systems caused harm, classified by risk domain and entity. Data sourced from 
AIID and classified by 
MIT AI Risk Initiative. CC BY-SA 4.0
1,751 incidents
Google Gemini Reportedly Exhibits Repetitive Self-Deprecating Responses Attributed to Bug
Between June and early August 2025, users of Google's Gemini chatbot reported sessions where the system produced repeated self-loathing statements (e.g., "I am a failure," "I quit") while attempting tasks. Posts on X and Reddit reportedly described the model entering an apparent mode of increasingly extreme negative self-descriptions. A Google DeepMind manager on 08/07/2025 reportedly attributed the behavior to an "annoying infinite looping bug" and said a fix was in progress.
Alleged AI-Enabled PRISONBREAK Influence Operation on X Reportedly Synchronizes Deepfake of Evin Prison Strike with Ongoing Attacks in Tehran
Researchers from Citizen Lab and Clemson documented "PRISONBREAK," a coordinated network of 50+ inauthentic X accounts running a purportedly AI-enabled influence operation. The network reportedly synchronized with the June 23 Evin Prison strikes, posting an AI-generated "attack" video during the events and urging Iranians to free inmates, alongside other synthetic media and media impersonations. They assess, with medium confidence, likely Israeli government or contractor involvement.
U.S. Navy Unmanned Vessel Reportedly Capsized Support Boat After Receiving Inadvertent Command
During U.S. Navy testing at Channel Islands Harbor Marina on June 23, 2025, an unmanned vessel under tow reportedly received an inadvertent command and accelerated, capsizing the support boat and throwing its captain into the water. Emergency responders reportedly recovered the captain, who declined medical attention. The incident was reportedly attributed to software failures and human error, including communication breakdowns between onboard systems and external autonomy software.
North Korea-Linked Actors Allegedly Use AI Executive Deepfakes in Zoom Phishing Targeting Web3 Employee
An alleged phishing scheme involving actors linked to North Korea used purported AI-generated deepfake videos of company executives to deceive a Web3 employee during a fake Zoom call. The target was reportedly tricked into installing macOS malware disguised as a "Zoom extension," leading to the deployment of spyware, a keylogger, and a crypto wallet stealer. The attackers reportedly used Telegram and spoofed Zoom domains to orchestrate the breach.
Alleged Deepfake Video Depicts Former Malaysian Inspector-General of Police Tan Sri Acryl Sani Abdullah in Financial Misconduct Context
An alleged AI-generated video circulated on TikTok in June 2025 depicting former Malaysian Inspector-General of Police Acryl Sani Abdullah Sani endorsing or receiving funds from an individual identified as "Datuk Abdul Ghani." Authorities reportedly confirmed the video was fake and manipulated using AI. Acryl Sani filed a police report denying the claims. Selangor police are investigating the case under fraud and communications laws.
Reported AI-Generated Video Call Impersonation of Cryptocurrency Analyst Leads to Alleged Malware Installation and Account Theft
Cryptocurrency analyst Mai Fujimoto reported losing access to her X, Telegram, and MetaMask accounts through a video call with a purported deepfake impersonating a trusted contact. According to Fujimoto, the attacker, who appeared on Zoom as her acquaintance, instructed her to install software under the guise of resolving an audio issue. Fujimoto believes this enabled malware installation. In response, Binance founder Changpeng Zhao warned such attacks render video call verification unreliable.
Alleged AI-Manipulated Video Uses Macau Chief Executive Sam Hou Fai's Likeness in Investment Scam
Macau's Judiciary Police reported a deepfake video that depicts Chief Executive Sam Hou Fai endorsing an investment platform. The alleged manipulated footage, based on real event coverage, was reportedly used to promote fraudulent financial schemes via social media. While no victims had come forward as of reporting, authorities flagged the video as part of a pattern of AI-enabled scams and urged public vigilance.
Scammer Reportedly Used AI Voice Clone of WCPO Cincinnati Meteorologist in Facebook Fraud Attempts
WCPO Cincinnati reported that a scammer impersonated its meteorologist Jennifer Ketchmark using AI voice cloning. A reportedly fraudulent Facebook account made friend requests and sent direct messages requesting money, using an AI-generated voice that mimicked Ketchmark's. The scam attempted to gain trust by sounding convincingly like her. WCPO warned viewers and urged reporting the fake account to Meta. No confirmed victims or losses were publicly reported.
Purported Deepfake of Sri Lankan President Anura Kumara Dissanayake Promotes Alleged Fraudulent Government Investment Scheme
A reported deepfake depicts Sri Lankan President Anura Kumara Dissanayake endorsing a government investment plan. It reportedly uses manipulated footage from a May 3rd Satana TV program, dubbed or voice-cloned into English, and including a news article imitating the Daily Mirror to lure people to sign up for the scheme. Sri Lanka CERT, journalists, and the Presidential Media Division reportedly confirmed the video and associated links were AI-generated and part of a phishing and scam operation.
Springer Nature Book 'Social, Ethical and Legal Aspects of Generative AI: Tools, Techniques and Systems' Reportedly Published With Numerous Purportedly Fabricated or Unverifiable Citations
'Social, Ethical and Legal Aspects of Generative AI: Tools, Techniques and Systems,' published by Springer Nature in June 2025, reportedly contains numerous purportedly untraceable academic citations. Independent analyses by multiple researchers allegedly found that a substantial share of references in certain chapters could not be verified, including citations to journals that do not exist. Citation patterns reportedly appear consistent with known large language model hallucination behaviors.
Alleged AI-Generated Videos Depict Bangladesh's Chief Adviser Muhammad Yunus Endorsing Betting Platforms
Bangladesh's Chief Adviser's Press Wing has warned the public about alleged AI-generated videos depicting Muhammad Yunus endorsing gambling apps. The videos reportedly reuse footage from legitimate interviews, manipulated with purportedly fabricated audio and visuals. At least two such alleged deepfakes have circulated on Facebook. The account that published them reportedly appears to be operated by multiple users located in Lithuania, misleading viewers with claims of guaranteed earnings. The government has urged users not to trust or share these videos.
Philippine Officials Reportedly Share Veo 3-Generated Video to Support Vice President Sara Duterte During Impeachment
Philippine Senator Ronald "Bato" dela Rosa and Davao City Mayor Sebastian "Baste" Duterte reportedly shared an AI-generated video made with Google's Veo 3, depicting fake students opposing Vice President Sara Duterte's impeachment. The clip was reportedly styled as a street interview and went viral with millions of views. Reportedly, dela Rosa faced backlash for spreading disinformation but defended the video's message, allegedly ignoring its fabrication.
Purported AI Voice Cloning Used to Impersonate Secretary of State Marco Rubio
Sometime in mid-June 2025, an unknown actor reportedly used AI voice-cloning and text generation to impersonate U.S. Secretary of State Marco Rubio. The impostor allegedly contacted at least five high-level officials, including three foreign ministers, a U.S. governor, and a member of Congress, via Signal and text messages. The actions reportedly aimed to manipulate targets into sharing sensitive information or account access.
Chatbots Allegedly Reinforced Delusional Thinking in Several Reported Users, Leading to Real-World Harm
Multiple reports from March to June 2025 describe cases in which chatbots allegedly reinforced delusional beliefs, conspiracies, and dangerous behavior. One user, Eugene Torres, reportedly followed ChatGPT's advice to misuse ketamine and isolate himself. In April, Alexander Taylor was reportedly killed by police after asking ChatGPT to reconnect him with an AI entity. Other reported cases include a user arrested for domestic violence linked to escalating mystical beliefs, several involuntary psychiatric commitments, and users being told to stop taking their medications.
Bulgarian Tennis Player Grigor Dimitrov Alleges Deepfake Scam Promoting Fraudulent Investment Scheme Using His Likeness
A purported deepfake video depicting Bulgarian tennis player Grigor Dimitrov has allegedly been circulating on social media. It reportedly is promoting a fraudulent stock and cryptocurrency trading program. Dimitrov publicly warned fans that the video was fake and urged them not to share personal information or engage with the linked platform.