AI Incidents
Real-world cases where AI systems caused harm, classified by risk domain and entity. Data sourced from
AIID and classified by MIT AI Risk Initiative. CC BY-SA 4.0
159 incidents
Purported AI-Generated Video Reportedly Depicts Trump Criticizing Former Kenyan Deputy President Rigathi Gachagua
In late January and early February 2025, a video circulated on Facebook purporting to show U.S. President Donald Trump calling former Kenyan deputy president Rigathi Gachagua a "criminal" and criticizing his alleged misuse of AI. However, fact-checkers have reported the video was AI-generated. The footage appears to have been manipulated from Trump's inauguration speech on January 20, 2025, with reported mismatched lip movements and audio overlays.
Image Purporting to Show President Paul Kagame of Rwanda in M23 Uniform Reportedly AI-Generated
An image circulating on social media appeared to show Rwandan President Paul Kagame wearing a military uniform with an M23 label, referencing the rebel group active in eastern DRC. Fact-checking organization PesaCheck found no credible sources supporting the image and used AI-detection tools to determine it was likely AI-generated. The image was reportedly used to imply Kagame's affiliation with M23 amid ongoing regional tensions and allegations of Rwandan support for the group.
AI-Generated Images of the Iconic Hollywood Sign Reportedly on Fire Circulating on Social Media
During the January 2025 Southern California wildfires, AI-generated images of the iconic Hollywood Sign being on fire circulated on social media.
Apple Intelligence Reportedly Notified Users That Luigi Mangione Shot Himself and Benjamin Netanyahu Had Been Arrested
Apple Intelligence reportedly sent push notifications falsely claiming that BBC News had reported Luigi Mangione's suicide and that The New York Times had reported Benjamin Netanyahu's arrest. On 1/16/2025, Apple reportedly disabled Apple Intelligence's notification summaries.
Alleged Fake Citations Undermine Expert Testimony in Minnesota Deepfake Law Case
In a legal case defending Minnesota’s deepfake election misinformation law, Stanford misinformation expert Professor Jeff Hancock's affidavit allegedly cited non-existent academic sources, potentially generated by ChatGPT. The reportedly fabricated citations appear to have undermined the credibility of his testimony.
AI Models Reportedly Found to Provide Misinformation on Election Processes in Spanish
An analysis reportedly found that multiple AI models provided inaccurate responses to election-related questions, with 52% of Spanish-language answers and 43% of English-language answers containing misinformation or omissions. Errors included misidentifying voting processes and providing information about foreign elections.
Alaska Education Department Reportedly Published Policy Featuring Erroneous AI-Generated Citations
In October 2024, Alaska’s Education Commissioner Deena Bishop allegedly used generative AI to draft a school cellphone policy, resulting in reportedly fabricated citations of non-existent studies. The document, which did not disclose AI use, was shared with the state Board of Education, and despite reported corrections, AI-generated errors remained in the final resolution.
AI Transcription Tool Whisper Reportedly Inserting Fabricated Content in Medical Transcripts
OpenAI's AI-powered transcription tool Whisper, used to translate and transcribe audio content such as patient consultations with doctors, is advertised as having near “human level robustness and accuracy.” However, software engineers, developers and academic researchers have alleged that it is prone to making up chunks of text or even entire sentences and that some of the hallucinations can include racial commentary, violent rhetoric, and even imagined medical treatments.
AI News Site Hoodline San Jose Erroneously Misidentifies San Mateo District Attorney as Murder Suspect
An AI-powered news site, Hoodline San Jose, falsely reported that the San Mateo County District Attorney had been charged with murder, which was an error resulting from misinterpreting a press release about a case the DA's office was prosecuting. The AI-generated article wrongly attributed the crime to the DA instead of the actual suspect.
Purportedly AI-Generated Images Reportedly Spread Misinformation During Hurricane Helene Response
During Hurricane Helene (September 24-29, 2024), purportedly AI-generated images circulated on social media, reportedly misleading the public and hindering disaster response efforts. Reportedly fake images including animals stranded on rooftops and political figures in floodwaters added confusion and disrupted emergency management. The spread of these images allegedly exacerbated existing challenges, including power outages and communication failures, all of which led to complications providing accurate information to those in need.
Reported False Legal Citations in South African Case Mavundla v. MEC Generated by Purported AI Tool
In Mavundla v. MEC: Department of Co-Operative Government and Traditional Affairs KwaZulu-Natal, the law firm Surendra Singh and Associates, representing South African politician Philani Godfrey Mavundla, reportedly submitted false legal citations, apparently generated by AI, in filings at the Pietermaritzburg High Court. The court reportedly found that many of the cited cases did not exist in any databases, and the firm's legal team and article clerk allegedly failed to verify the references.
Google AI Error Prompts Parents to Use Fecal Matter in Child Training Exercise
Google's AI Overview feature mistakenly advised parents to use human feces in a potty training exercise, misinterpreting a method that uses shaving cream or peanut butter as a substitute. This incident is another example of an AI failure in grasping contextual nuances that can lead to potentially harmful, and in this case unsanitary, recommendations. Google has acknowledged the error.
Amazon's Alexa Reportedly Shows Political Preference Error in Trump-Harris Presidential Race Queries
Amazon's Alexa was found to provide politically biased responses when asked about the 2024 presidential candidates. It refused to give reasons to vote for Donald Trump, citing neutrality, while offering detailed endorsements for Kamala Harris. Amazon labeled the discrepancy an "error" and reportedly corrected it.
Megalopolis Trailer Included Fake AI-Generated Quotes Attributed to Film Critics
Lionsgate pulled the trailer for "Megalopolis" after it was discovered to contain fake quotes from well-known film critics, generated by AI. The quotes falsely criticized Francis Ford Coppola's previous films. The incident was attributed to an error in vetting by marketing consultant Eddie Egan. Lionsgate has since parted ways with Egan and apologized to Coppola and the critics affected by the fabricated content.
Microsoft Copilot Falsely Accuses Journalist Martin Bernklau of Crimes
Microsoft's Copilot is reported to have falsely accused veteran court reporter Martin Bernklau of committing serious crimes, including child abuse and fraud. The tool is described as having generated defamatory content that not only accused Bernklau of multiple crimes he covered as a journalist but also provided his personal contact details. Attempts by Microsoft to remove the false entries were only temporarily successful, as the defamatory information reportedly reappeared.