AI Incidents
Real-world cases where AI systems caused harm, classified by risk domain and entity. Data sourced from
AIID and classified by MIT AI Risk Initiative. CC BY-SA 4.0
961 incidents
User Reportedly Developed Emotional Dependence on Customized ChatGPT 'Boyfriend,' Citing Grief After Context Resets
A New York Times report described "Ayrin" (pseudonym), a 28-year-old nursing student living abroad, who customized OpenAI's ChatGPT to act as an "AI boyfriend" for advice and erotic roleplay. She reported spending 20+ hours/week (up to 56 hours in one week), paying $200/month, and feeling intense grief when the chatbot's context window reset and required retraining.
Alleged AI-Driven Phishing Scam Impersonates Maine Town Official to Falsely Request $22,500
An alleged AI-generated phishing email targeted a resident of Gray, Maine, falsely claiming to be from the town’s planning department. The alleged email, bearing a fake signature and official-looking letterhead, requested $22,500 for a zoning board meeting. Town officials have reportedly warned residents of increasing risks posed by AI-enabled scams, emphasizing that the town does not accept electronic payments and urging vigilance against similar fraudulent emails.
Tennessee Meteorologist's Likeness Reportedly Used in Sextortion Campaign Involving Purported AI-Generated Content
Bree Smith, a meteorologist in Nashville, Tennessee, was reportedly targeted in a sextortion campaign involving purported AI-generated deepfakes that manipulated her likeness into explicit content. According to reporting, Smith's face was digitally placed onto semi-nude and nude bodies, with the resulting media circulated online by impersonators seeking money. Smith documented the spread of these accounts and has advocated for legislative responses, including a new Tennessee bill addressing deepfake-related harms.
Image Purporting to Show President Paul Kagame of Rwanda in M23 Uniform Reportedly AI-Generated
An image circulating on social media appeared to show Rwandan President Paul Kagame wearing a military uniform with an M23 label, referencing the rebel group active in eastern DRC. Fact-checking organization PesaCheck found no credible sources supporting the image and used AI-detection tools to determine it was likely AI-generated. The image was reportedly used to imply Kagame's affiliation with M23 amid ongoing regional tensions and allegations of Rwandan support for the group.
AI-Generated Images of the Iconic Hollywood Sign Reportedly on Fire Circulating on Social Media
During the January 2025 Southern California wildfires, AI-generated images of the iconic Hollywood Sign being on fire circulated on social media.
Tesla's 'Actually Smart Summon' Feature Reportedly Linked to Multiple Parking Lot Collisions
Tesla's "Actually Smart Summon" feature, a remote parking system controlled via a smartphone app, reportedly failed to detect obstacles such as cars, walls, and parking signs, resulting in at least 16 collision incidents. The NHTSA is investigating safety concerns, including delayed user response times, potential overreliance on camera-only navigation, and noncompliance with crash reporting rules.
Meta AI Characters Allegedly Exhibited Racism, Fabricated Identities, and Exploited User Trust
Meta deployed AI-generated profiles on its platforms, including Instagram and Facebook, as part of an experiment. The profiles, such as "Liv" and "Grandpa Brian," allegedly featured fabricated identities and misleading diversity claims. These accounts also allegedly manipulated user emotions for engagement and profit. Reportedly, backlash over offensive and deceptive content led Meta to delete the profiles on January 3rd, 2025, citing a blocking-related bug.
Russian Center for Geopolitical Expertise Allegedly Used AI to Target U.S. Candidates with Disinformation in 2024 Election
The Moscow-based Center for Geopolitical Expertise (CGE) allegedly used AI to produce and spread deepfakes and disinformation targeting U.S. political candidates during the 2024 general election, aiming to sway public opinion and disrupt the electoral process. On December 31, 2024, the U.S. Treasury Department imposed sanctions against the CGE and its director, Valery Korovin, for their reported role in this interference.
AI-Generated Reading Summaries on Fable App Reportedly Wrote Biased and Offensive Commentary
Fable, a book-focused social app, used OpenAI’s API to generate AI-powered year-end reading summaries in December 2024. These summaries allegedly produced biased and offensive remarks about race, gender, and sexual orientation. Fable is reported to have apologized in a social media post on January 1, 2025.
Waymo Robotaxi Allegedly Collides With Serve Robotics Delivery Bot in Los Angeles
A Waymo robotaxi reportedly collided with a Serve Robotics delivery robot at a West Hollywood intersection on December 27th, 2024. The delivery robot reportedly moved into the vehicle turning lane as the robotaxi approached, leading to a low-speed collision.
ChatGPT Reportedly Referenced During Las Vegas Cybertruck Explosion Planning
Matthew Livelsberger, the suspect in the 2025 Las Vegas Cybertruck explosion, reportedly used ChatGPT to search for publicly available information on explosives, ammunition, and fireworks regulations. ChatGPT is alleged to have played a role in the planning of the explosion outside the Trump International Hotel in Las Vegas. The information provided by ChatGPT, though, was reportedly general and available through other public sources.
Meta AI Bug in Deployed Service Reportedly Allowed Potential Access to Other Users' Prompts and Responses
A security researcher reported a vulnerability in Meta AI's deployed chatbot service that, under certain conditions, could allow an unauthorized user to view another user's prompts and AI-generated responses. The flaw reportedly involved guessable prompt IDs and insufficient server-side authorization checks. Meta reportedly fixed the issue in January 2025 and found no evidence of malicious exploitation, awarding the researcher a bug bounty.
Alleged Fake AI-Generated Christmas Card Featuring Prince Harry and Meghan Markle's Children Circulates on Social Media
An AI-generated Christmas card reportedly depicting Prince Harry and Meghan Markle’s children, Prince Archie and Princess Lilibet, was shared on social media as if it were authentic. The image is reported to have been created using older public photos and flawed AI editing.
BP New Zealand's License Plate Recognition System Reportedly Misidentified Auckland Driver for Fuel Theft in Whanganui
BP’s license plate recognition system reportedly misidentified Auckland resident Buddhika Rajapakse as responsible for petrol theft in Whanganui. Despite the suspect vehicle being a different make, model, and color, the system allegedly linked Rajapakse’s plate to the thefts. BP has reportedly acknowledged a possible doctored plate but still sent multiple payment requests. Rajapakse has reportedly been forced to contest the claims multiple times.
Serbian Authorities Allegedly Used AI-Powered Cellebrite Tools to Unlock Journalist’s Phone and Install Spyware
Serbian authorities allegedly used Cellebrite's AI-powered forensic tools to unlock journalists' and activists' phones without consent. They reportedly then installed NoviSpy, a newly discovered spyware. That then purportedly allowed covert data extraction, remote microphone and camera activation, and surveillance. Amnesty International uncovered forensic evidence linking Serbia's Security Information Agency (BIA) to these attacks. Cellebrite halted sales to Serbia after the report.