AI Incidents
Real-world cases where AI systems caused harm, classified by risk domain and entity. Data sourced from 
AIID and classified by 
MIT AI Risk Initiative. CC BY-SA 4.0
197 incidents
Deepfake Video Targets Paul Vallas on Eve of Chicago Mayoral Election
On the eve of Chicago's mayoral election, a deepfake video impersonating candidate Paul Vallas was posted to Twitter, showing a fake audio of him making inflammatory statements. The video was viewed thousands of times before being taken down. The Vallas campaign condemned the video, calling it a deceptive impersonation.
UK Bank's Voice ID Successfully Bypassed Using AI-Produced Audio
A UK journalist was able to successfully bypass Lloyds Bank's "Voice ID" program to access his bank account using an AI-generated audio of his own voice.
Purported Deepfake TikTok Video Reportedly Featured Joe Rogan Endorsing Supplement Brand
A purported deepfake video featuring podcast host Joe Rogan reportedly advertising to his listeners about a "libido-boosting" supplement was circulating on TikTok and other platforms before being removed by TikTok along with the account which posted it.
Instagram Video Featured Deepfake Audio of US President Making Transphobic Remarks
A deepfaked audio of US President Joe Biden making transphobic remarks played on top of a video showing him giving a speech was released on Instagram and circulated on social media.
Alleged ChatGPT-Generated Book with a Duplicate Title, Fake Author, and Similar Content Surfaces on Amazon Ahead of Real Author's Book Release
The author Chris Cowell had spent more than a year writing his book "Automating DevOps with GitLab CI/CD Pipelines" when, three weeks before its release, another book appeared bearing the exact title by an author (Marie Karpos) for whom no information could be found. The book appeared to have been written by ChatGPT. While the original Washington Post story does not say so, it is possible the name and description were taken from the Amazon preorder page.
Non-consensual Deepfake Porn Targeted Female Content Creators
Unauthorized, non-consensual deepfake pornography showing faces of high-profile female streamers and content creators was published on a subscription-based website, which gained notoriety after a male streamer was caught accessing the site.
Mother in Arizona Received Fake Ransom Call Featuring AI Voice of Her Daughter
A mother in Arizona received a ransom call from an anonymous scammer who created her daughter's voice allegedly using AI voice synthesis, which was proven to be fake once her daughter's safety was confirmed.
Kate Isaacs, Advocate Against Image-Based Abuse, Reports Being Deepfaked
Kate Isaacs, a London-based activist and founder of the #NotYourPorn campaign, was targeted in a deepfake incident. Her face was alleged to have been digitally manipulated onto a pornographic video using AI and shared online. The reported video, tagged with her name, is alleged to have led to streams of abuse, doxing, and threats of violence. The attack reportedly followed her efforts to pressure PornHub to remove unverified content.
Weibo Model Had Difficulty Detecting Shifts in Censored Speech
Weibo's user moderation model is having difficulty keeping up with shifting user slang in defiance of Chinese state censors.
Fraudsters Use Deepfake Video of Tim Cook to Promote Apple Crypto Scam on YouTube
Fraudsters repurposed an old interview with Apple CEO Tim Cook using AI or video editing to promote a fake crypto event on YouTube. The altered video was designed to mislead viewers into believing Tim Cook endorsed a new cryptocurrency scheme. The stream attracted tens of thousands of viewers, potentially exposing them to the scam before it was removed for violating YouTube’s terms of service.
Northern Ireland MLA Cara Hunter Allegedly Targeted by Deepfake Pornography Ahead of May 2022 Assembly Election
Sometime in April 2022, reportedly some weeks before the May 5, 2022 Northern Ireland Assembly election, Member of the Legislative Assembly Cara Hunter was targeted in a deepfake pornography incident. A fake video depicting her in explicit scenarios is reported to have circulated widely on WhatsApp. Law enforcement have as of yet been unable to trace the origins of the video, according to reports. Additionally, it is alleged that about six months after the initial incident, she was the target of at least 15 more AI-generated deepfakes depicting her likeness in underwear.
AI-Generated Faces Used by Scammers to Pose as a Law Firm in Boston
GAN faces were allegedly used by scammers alongside a parked domain and a fake website to impersonate a Boston law firm.
Deepfake Video of Ukrainian President Yielding to Russia Posted on Ukrainian Websites and Social Media
A quickly-debunked deepfaked video of the Ukrainian President Volodymyr Zelenskyy was posted on various Ukrainian websites and social media platforms encouraging Ukrainians to surrender to Russian forces during the Russia-Ukraine war.
AI-Generated Deepfakes Reportedly Derailed Political Career of Florida Official
Sabrina Javellana, a Florida politician, was reportedly targeted with AI-generated deepfake pornography in February 2021, which was spread online, leading to severe emotional distress and her eventual withdrawal from public life.
Facebook Recommended Military Gear Ads Despite Pause on Weapons Accessories Ads
Facebook’s algorithmic recommendations reportedly continued showing advertisements for gun accessories and military gear, despite Facebook’s halt on weapons accessories ads following the US Capitol attack.