AI Incidents
Real-world cases where AI systems caused harm, classified by risk domain and entity. Data sourced from
AIID and classified by MIT AI Risk Initiative. CC BY-SA 4.0
271 incidents
Purported AI-Generated YouTube Network Reportedly Promoted Alberta Secession and U.S. Annexation Narratives
Researchers reported that a network of 20 inauthentic YouTube channels used purportedly AI-generated avatars and voiceovers with deepfake-style thumbnails, as well as paid voice actors, to pose as Albertan commentators and promote false or misleading claims about Alberta secession and U.S. annexation. The channels allegedly drew nearly 40 million views and distorted political debate, reportedly undermining Canada's information ecosystem.
Australian Analyst Allegedly Targeted by Scam Using Purportedly Sophisticated AI-Generated Corporate Materials
A report by ABC News Australia describes how scammers allegedly used AI tools to create detailed fake websites for two fabricated companies, APPC Capital Singapore and Thackeray Mines and Minerals Inc., as part of an investment scam. A pseudonymous Australian fraud analyst ("Leon") was reportedly targeted. Experts cited in the article warn that AI lowers the barrier for generating convincing scams that can deceive even experienced analysts.
Fact-Checkers Identify Viral Photo of Burkina Faso's Ibrahim Traoré with 'Wife and Children' as AI-Generated Composite
A manipulated image allegedly showing Burkina Faso junta leader Ibrahim Traoré with a wife and three children circulated widely on social media. Investigations by GhanaFact and others concluded the image was altered using AI tools, merging Traoré's likeness from a 2023 Russia-Africa summit photo with fabricated figures. The harm stems from the spread of false personal information about a political figure, potentially shaping public perception through synthetic, misleading media.
Reported AI-Generated Video Purportedly Depicting Keanu Reeves Debating Elon Musk Circulates as Misinformation on Social Media
In April 2025, a video circulated online reportedly depicting a televised debate between Keanu Reeves and Elon Musk about AI. The video, posted by the YouTube channel Voices of Change, purportedly used AI-generated voice and visual content to simulate the event. Independent analysis found signs of deepfake audio and imagery, and no credible evidence supported the event's existence.
Purported Deepfake Depicts Altercation Between Bougainville President Ishmael Toroama and Papua New Guinea Prime Minister James Marape
A purported AI‑generated deepfake video circulated online falsely depicting a physical altercation between Bougainville President Ishmael Toroama and Papua New Guinea Prime Minister James Marape. The footage reportedly caused public confusion and risked damaging relations between Bougainville and Papua New Guinea. Toroama reportedly condemned the video as false and malicious, as well as potentially destabilizing, urging stronger action against misleading AI‑generated content.
Baltimore Lawsuit Alleged DraftKings and FanDuel Used Machine-Learning-Driven Targeting to Exploit Vulnerable Gamblers
In Baltimore, the city sued DraftKings and FanDuel, alleging that the companies used predictive modeling with machine-learning algorithms, extensive user data, personalized promotions, push notifications, and VIP programs to identify and exploit vulnerable bettors, including people showing signs of gambling disorder. The complaint alleges these systems were designed to maximize user lifetime value and contributed to financial and public-health harms among Baltimore residents.
Reported AI‑Generated Deepfake Impersonations of Public Figures Allegedly Used in Coordinated Stock Pump‑and‑Dump Scheme Targeting Israeli Investors
A coordinated fraud campaign in Israel allegedly used AI‑generated deepfake impersonations of public figures including Amir Yaron, Benjamin Netanyahu, Eyal Golan, Noa Kirel, Gal Gadot, Elon Musk, and Mark Zuckerberg to promote NASDAQ‑listed Ostin Technology Group Co. Ltd. (OST) in a pump‑and‑dump scheme. Paid social media ads, WhatsApp groups, and fake investment platforms reportedly lured investors before the stock collapsed in early July 2025, causing major reported losses.
Fact-Checking Finds Reportedly AI-Generated Video Misattributed Hypertension Cure Endorsements to Taiwo Ajai-Lycett and Chinonso Egemba
Fact-checking reports that a purported AI-generated video circulated on Facebook depicting veteran actor Taiwo Ajai-Lycett discussing a hypertension diagnosis and promoting an unproven treatment by influencer Chinonso Egemba. According to the report, the video exhibited signs of AI generation, including unnatural speech and mismatched lip movements. Both Ajai-Lycett and Egemba have denied involvement, and no credible medical evidence supports the claimed cure.
LLM Scrapers Allegedly Target Multiple Open Source Projects Disrupting the FOSS Ecosystem
In mid-March 2025, KDE's GitLab infrastructure was reportedly disrupted by aggressive AI web scrapers originating from Alibaba IP ranges. These bots allegedly ignored robots.txt and spoofed browser headers, which in turn purportedly overwhelmed the site and caused outages for developers. Similar incidents reportedly affected other FOSS projects like GNOME, SourceHut, and Fedora. The scraping is allegedly tied to large language model training, and reportedly imposes real costs and delays.
AI-Generated Voice Cloning of Trump Falsely Proposes Renaming the District of Columbia to the District of America
A viral audio clip circulating on TikTok, Facebook, X, and other platforms falsely portrayed Donald Trump saying he would rename Washington, D.C. as the "District of America." The voice was confirmed to be AI-generated by digital forensics experts. It was initially posted by a now-deleted TikTok account. The clip is reported to have spread rapidly across political lines before it was debunked.
Financial Times Journalist Martin Wolf Reports AI-Generated Investment Scam Using His Likeness on Instagram and Facebook
Beginning in March 2025, purported deepfakes impersonating Financial Times columnist Martin Wolf were distributed via ads on Facebook and Instagram, promoting an alleged fraudulent investment group. Despite repeated takedowns, the ads have reportedly persisted under new accounts. Meta data reportedly showed at least 1,700 ads reached over 970,000 users in the EU alone. The impersonations allegedly used AI-generated visuals and voice clones to mimic Wolf's likeness and mislead users.
AI-Generated Songs Allegedly Imitating Céline Dion Circulate Online Without Authorization
Céline Dion has publicly condemned AI-generated music that falsely claims to feature her voice without her permission. In a March 7, 2025 statement, her team warned fans that these recordings are fake and unauthorized.
Tbilisi-Based Call Center Allegedly Uses AI-Driven Scripts to Defraud Over 6,000 Victims of $35 Million
A large-scale AI-assisted financial scam, allegedly operated from Tbilisi, Georgia, used deepfake celebrity endorsements and manipulated victims through fraudulent trading dashboards that simulated high returns. Call center agents, trained with AI-driven persuasion tactics, convinced individuals to invest more money while falsely promising profits. Many reportedly lost their life savings, with the total losses reaching $35M across more than 6,000 victims.
Purported Deepfake Audio Allegedly Impersonates U.S. Secretary of State Marco Rubio in Starlink Disinformation Campaign
A purported deepfake audio clip allegedly impersonating U.S. Secretary of State Marco Rubio falsely claimed he vowed to pressure Elon Musk into cutting Ukraine’s access to Starlink. The reported clip was inserted into a purportedly manipulated CNN interview. It was then reported to have spread across multiple languages and fueled disinformation about U.S.-Ukraine relations. Forensic analysis reportedly confirmed the audio was AI-generated.
Purported AI-Generated Images Reportedly Used in Sextortion Scheme Targeting Glasgow, Kentucky Teen Who Later Died by Suicide
16-year-old Elijah Heacock of Glasgow, Kentucky, reportedly died by suicide on February 28, 2025, after receiving threatening messages containing purportedly AI-generated explicit images depicting him. The images were reportedly used in a sextortion attempt demanding money. The FBI has been investigating the case as part of an alleged pattern of online financial sextortion schemes targeting minors.