AI Incidents
Real-world cases where AI systems caused harm, classified by risk domain and entity. Data sourced from
AIID and classified by MIT AI Risk Initiative. CC BY-SA 4.0
197 incidents
Fact-Checking Finds Reportedly AI-Generated Video Misattributed Hypertension Cure Endorsements to Taiwo Ajai-Lycett and Chinonso Egemba
Fact-checking reports that a purported AI-generated video circulated on Facebook depicting veteran actor Taiwo Ajai-Lycett discussing a hypertension diagnosis and promoting an unproven treatment by influencer Chinonso Egemba. According to the report, the video exhibited signs of AI generation, including unnatural speech and mismatched lip movements. Both Ajai-Lycett and Egemba have denied involvement, and no credible medical evidence supports the claimed cure.
AI-Generated Voice Cloning of Trump Falsely Proposes Renaming the District of Columbia to the District of America
A viral audio clip circulating on TikTok, Facebook, X, and other platforms falsely portrayed Donald Trump saying he would rename Washington, D.C. as the "District of America." The voice was confirmed to be AI-generated by digital forensics experts. It was initially posted by a now-deleted TikTok account. The clip is reported to have spread rapidly across political lines before it was debunked.
Financial Times Journalist Martin Wolf Reports AI-Generated Investment Scam Using His Likeness on Instagram and Facebook
Beginning in March 2025, purported deepfakes impersonating Financial Times columnist Martin Wolf were distributed via ads on Facebook and Instagram, promoting an alleged fraudulent investment group. Despite repeated takedowns, the ads have reportedly persisted under new accounts. Meta data reportedly showed at least 1,700 ads reached over 970,000 users in the EU alone. The impersonations allegedly used AI-generated visuals and voice clones to mimic Wolf's likeness and mislead users.
AI-Generated Songs Allegedly Imitating Céline Dion Circulate Online Without Authorization
Céline Dion has publicly condemned AI-generated music that falsely claims to feature her voice without her permission. In a March 7, 2025 statement, her team warned fans that these recordings are fake and unauthorized.
Tbilisi-Based Call Center Allegedly Uses AI-Driven Scripts to Defraud Over 6,000 Victims of $35 Million
A large-scale AI-assisted financial scam, allegedly operated from Tbilisi, Georgia, used deepfake celebrity endorsements and manipulated victims through fraudulent trading dashboards that simulated high returns. Call center agents, trained with AI-driven persuasion tactics, convinced individuals to invest more money while falsely promising profits. Many reportedly lost their life savings, with the total losses reaching $35M across more than 6,000 victims.
Purported Deepfake Audio Allegedly Impersonates U.S. Secretary of State Marco Rubio in Starlink Disinformation Campaign
A purported deepfake audio clip allegedly impersonating U.S. Secretary of State Marco Rubio falsely claimed he vowed to pressure Elon Musk into cutting Ukraine’s access to Starlink. The reported clip was inserted into a purportedly manipulated CNN interview. It was then reported to have spread across multiple languages and fueled disinformation about U.S.-Ukraine relations. Forensic analysis reportedly confirmed the audio was AI-generated.
Purported AI-Generated Images Reportedly Used in Sextortion Scheme Targeting Glasgow, Kentucky Teen Who Later Died by Suicide
16-year-old Elijah Heacock of Glasgow, Kentucky, reportedly died by suicide on February 28, 2025, after receiving threatening messages containing purportedly AI-generated explicit images depicting him. The images were reportedly used in a sextortion attempt demanding money. The FBI has been investigating the case as part of an alleged pattern of online financial sextortion schemes targeting minors.
Reported Deepfake of Maltese Prime Minister Robert Abela and Journalist Mark Laurence Zammit Used to Promote Fraudulent Investment
A deepfake scam allegedly used AI-generated audio to mimic Maltese Prime Minister Robert Abela and journalist Mark Laurence Zammit, falsely portraying them as endorsing an investment scheme. The fraudulent video repurposed genuine interview footage from 2022 but replaced the original dialogue with AI-generated voices.
AI-Driven Phishing Scam Uses Deepfake Robocalls to Target Gmail Users in Credential Theft Campaign
A sophisticated AI-powered phishing scam has reportedly been targeting between 1.8 to 2.5 billion Gmail users, allegedly using deepfake robocalls and phishing emails to steal credentials. Attackers impersonate Google security. They claim suspicious account activity and direct victims to fake Google login pages. The stolen credentials have reportedly been used for identity theft, banking fraud, and session hijacking. The FBI has urged vigilance as AI increases the scale and effectiveness of such attacks.
Nottingham Gallery Owner Allegedly Defrauded by Deepfake Impersonating Pierce Brosnan, Reportedly Leading to Business Closure
Nottingham gallery owner Simone Simms was allegedly deceived over many months by a deepfake impersonating actor Pierce Brosnan. Believing she was in direct contact with Brosnan, she reportedly arranged an art exhibition and sold £20,000 in tickets. When the real Brosnan denied involvement, Simms reportedly canceled the event and issued refunds. Despite acting in good faith, she reportedly faced reputational and financial harm, which led to the gallery’s closure in August 2024.
Reportedly Viral USAID Disinformation Video Linked to Russian-Aligned Campaign Known as Matryoshka
A video that reportedly went viral on X in early February 2025 claimed USAID paid celebrities to visit Ukraine. The clip mimicked E! News branding and included a narrator with a British accent. Individuals and organizations named denied any involvement. Researchers attributed the video to Matryoshka (AKA Operation Overload and Storm-1679), an influence campaign suspected of using AI-generated narration and editing, though tool use has not been independently confirmed.
AI Voice Scam Allegedly Defrauds Game and Coffee Store in Havre, Montana
A Montana business, Sugar and Dice, was reportedly targeted by an AI voice scam that cloned the store owner's voice to deceive an employee over the phone. The scammer allegedly spoofed both the owner's and the employee's phone numbers, making the call appear legitimate. Believing he was following his employer’s instructions, the employee unknowingly compromised financial details. The store suffered monetary losses but plans to recover.
Fraudsters Allegedly Use AI-Generated Voice of Italian Defense Minister Guido Crosetto to Scam Business Leaders
In February 2025, scammers allegedly used AI voice cloning to impersonate Italian Defense Minister Guido Crosetto, calling top business leaders and reportedly claiming to need funds to free kidnapped journalists. Massimo Moratti was allegedly the only confirmed victim to send nearly €1M, wiring it to accounts in the Netherlands and Hong Kong before realizing the fraud. The scam involved spoofed government numbers, deepfake audio, and international money laundering networks. Police reportedly froze the funds.
Alleged Deepfake Scam Uses BBC Presenter Naga Munchetty’s Image to Promote Fraudulent Investment Scheme
BBC presenter Naga Munchetty was reportedly targeted in an AI-generated scam using deepfake images and fake news articles to promote a fraudulent investment scheme. Scam ads on social media allegedly featured manipulated images of Munchetty and linked to a fake BBC article directing users to a cyber trading website. The BBC legal team is reported to have taken action to remove the fraudulent site.
Purportedly AI-Generated Deepfake Image Reportedly Falsely Links Canadian Prime Minister Mark Carney to Jeffrey Epstein
A purportedly AI-generated image that reportedly circulated on social media falsely depicted Canadian Prime Minister Mark Carney in a swimming pool with Jeffrey Epstein, implying involvement in Epstein's sex crimes. The manipulated image reportedly spread widely in early 2025, first around the time of Justin Trudeau's announced resignation, then after Carney became Liberal Party leader, and was reportedly promoted by Canadian and U.S. conservative accounts.