AI Incidents
Real-world cases where AI systems caused harm, classified by risk domain and entity. Data sourced from 
AIID and classified by 
MIT AI Risk Initiative. CC BY-SA 4.0
566 incidents
Jennifer Aniston’s Likeness Allegedly Exploited in Purported Deepfake Collagen Supplement Promotion
A purportedly AI-generated deepfake video featuring Jennifer Aniston falsely promoting collagen supplements reportedly circulated on Facebook, misleading viewers about her involvement. The video, reportedly created without her consent, used footage from a previous roundtable interview, purportedly modified by AI to advertise health products.
Two Members of Highline Public Schools Community in King County, Washington Reportedly Targeted in Deepfake Kidnapping Scam
Two members of the Highline Public Schools community in Burien, a town in King County, Washington, were reportedly targeted in a deepfake kidnapping scam. Scammers allegedly used AI-generated voice cloning technology to convincingly mimic the voices of their family members. The scammers reportedly used the altered voices to claim they had been kidnapped and demanding a ransom be paid.
Russian Influence Operation Allegedly Uses AI to Create Fake Kamala Harris Campaign Website and Rhino-Hunting Hoax
A Russian disinformation campaign, linked to Storm-1516 and Kremlin propagandist John Mark Dougan, allegedly used AI-generated content to target Kamala Harris’s election bid. The operation included a fake campaign website promoting extreme policies and an AI-enhanced deepfake video falsely claiming Harris killed an endangered rhino in Zambia. The hoaxes were spread via Telegram, X, VK, and pro-Kremlin media outlets.
Scammers Allegedly Use AI-Generated Avatars to Impersonate Friends in Houston, Texas and Solicit Money
Two Houston women reported being targeted in an alleged scam involving AI-generated videos that appeared to depict trusted friends. The purported deepfake avatars were reportedly used via social media and messaging apps to solicit access codes and promote fraudulent sales. Victims are reported to have lost control of their accounts, and friends of the impersonated individuals sent money believing the videos were authentic.
Senator Ben Cardin Reportedly Received a Purported Deepfake Zoom Call Impersonating Former Ukrainian Foreign Minister Dmytro Kuleba
Senator Ben Cardin was reportedly targeted with a purported deepfake on a Zoom call that appeared to imitate former Ukrainian Foreign Minister Dmytro Kuleba. The allegedly AI-generated video reproduced his likeness and voice but drew attention when the caller asked unusual questions.
Deepfake Reportedly Used in Attempted Real Estate Fraud in Hallandale Beach, Florida
A scammer reportedly used deepfake technology to impersonate the owner of a vacant Hallandale Beach, Florida lot during a Zoom call. The scam matched forged IDs to public property records and nearly succeeded in defrauding the buyer of $52,000. The image used in the deepfake was reportedly that of a missing woman named Margrit Pritchard.
AI-Generated Media Reportedly Used in Russian Disinformation Campaign in Moldova
Russian-linked entities allegedly deployed AI-generated images and videos to spread disinformation aimed at swaying Moldova’s referendum on E.U. membership. The AI-enhanced media campaign included fabricated stories and doctored visuals, the purpose of which was reportedly designed to amplify fear and undermine pro-E.U. sentiment in the days leading up to the referendum.
Purportedly AI-Generated Audio Allegedly Fabricates Biden's Admission of Role in Pakistani Political Crisis
A purported deepfake audio file is alleged to have falsely claimed that U.S. President Joe Biden conspired with Pakistan's Army Chief, General Syed Asim Munir, to remove former Prime Minister Imran Khan in 2022. Widely shared online, the audio is reported to have exploited generative AI to spread political misinformation.
Purported Deepfake of Brian May Allegedly Exploited in Scam Offering Fake Queen Backstage Tickets
Scammers allegedly created an AI-generated deepfake of Queen guitarist Brian May, reportedly posting a video on TikTok in which the fake May offers backstage tickets to a Queen concert. The real Brian May reportedly warned fans about this "disgusting" scam, emphasizing that Queen has no tour dates planned and does not sell backstage access.
Criminal Group Uses AI Deepfake Technology to Steal Personal Data in Hangzhou, Zhejiang
A criminal group in China used AI face-swapping technology to bypass face recognition systems on major platforms, steal personal data, and sell it to fraud syndicates. The group generated convincing video simulations from static photos to breach accounts, reportedly earning 200,000 yuan. After an investigation by the Hangzhou Public Security Bureau, four suspects were arrested across the provinces of Anhui, Guizhou, and Zhejiang.
AI 'Nudify' Apps Used as Tools for Blackmail and Extortion
AI 'nudify' apps are being used to generate hyperrealistic non-consensual nude photos of individuals, which are then exploited for extortion and harassment. These apps use generative AI to remove clothing from images and create convincing fakes, often distributed on platforms like Telegram. Victims are threatened or shamed using these AI-generated images, with little recourse for removal or legal action.
Music Producer Michael Smith Reportedly Arrested for Allegedly Using AI-Generated Songs in $10 Million Streaming Scam
Music producer Michael Smith was reportedly arrested for allegedly using AI-generated songs and fake streaming accounts to scam over $10 million in royalties from major music platforms. By purportedly creating hundreds of thousands of songs and employing bots to artificially inflate streams, Smith reportedly circumvented fraud detection systems. The scheme was reportedly exposed after suspicions arose regarding the rapid generation of music and streaming anomalies.
Video with Reportedly AI-Generated Media Purported to Show Croatian Neurosurgeon Josip Paladino Endorsing Steplex in Fake TV Segment on Facebook
A Facebook page reportedly posted a video styled as a TV news segment that purported to show Croatian neurosurgeon Josip Paladino endorsing a pain-treatment product called Steplex after an on-air assault. The clip was reported to use AI-generated or manipulated media built from older footage, and the ad linked users to a page mimicking Croatia's Ministry of Health while soliciting purchases and contact data.
53% of American and British Businesses Report Attacks by AI-Powered Deepfake Scams in 2024
According to Medius, Deepfake scams have targeted 53% of businesses in the U.S. and U.K., with 43% falling victim. Using AI to create realistic fake videos and audio of corporate executives, scammers have successfully stolen millions, including $25 million from British engineering group Arup.
Elon Musk Reportedly Shared an AI-Generated Image Depicting Kamala Harris Dressed as a Communist Ruler
Elon Musk reportedly shared an AI-generated image on X depicting Kamala Harris as a "communist dictator" in response to her post about Donald Trump's political intentions.