AI Incidents
Real-world cases where AI systems caused harm, classified by risk domain and entity. Data sourced from
AIID and classified by MIT AI Risk Initiative. CC BY-SA 4.0
1,751 incidents
Deepfake Recordings Allegedly Influence Slovakian Election
Days before Slovakia's election, deepfake audio recordings surfaced, allegedly featuring conversations between a journalist and a leading liberal politician discussing vote-rigging and other controversial topics. The recordings were spread on social media platforms and may have influenced the election outcome, which saw the pro-Russian populist party winning.
Purported Mass Facial Recognition Program in Gaza Reportedly Used by Israeli Forces to Identify Palestinians
A previously undisclosed facial recognition initiative operated by Israeli military intelligence units was reportedly deployed across Gaza after the October 7, 2023 attacks. According to multiple intelligence officers, the program uses Corsight technology alongside Google Photos to identify individuals from checkpoints, crowds, and drone footage. The system has allegedly produced misidentifications, including the widely reported detention of Palestinian poet Mosab Abu Toha on November 19, 2023.
Facebook Messenger AI Stickers Generate Ethical and Content Moderation Concerns
Facebook Messenger AI stickers, a feature by Meta, allows users to generate personalized stickers via AI for use in conversations. While the feature has been praised for its creativity, it has also stirred controversy for its alleged production of inappropriate or offensive content. This has raised questions about the effectiveness of Meta's content moderation measures and the ethical responsibilities associated with AI-driven content generation.
Russia Reportedly Using Artificial Intelligence in Disinformation Campaigns to Erode Western Support for Ukraine
The Russian government has been stepping up its foreign influence campaigns by using artificial intelligence and emerging technologies to spread disinformation and sow distrust in policies supportive of Ukraine. Part of the strategy includes carrying out influence laundering operations by disseminating their messages to the American public via allies inside nominally independent organizations, according to a recent declassified analysis.
Deepfaked Advertisements Using the Likenesses of Celebrities Such as Tom Hanks and Gayle King Without Their Consent
Deepfake technology was used to generate video advertisements featuring celebrities. Notable examples include the likeness of Tom Hanks touting a dental plan and another one in which the likeness of Gayle King touts a weight loss product. In each case, the individuals whose likenesses and voices had been deepfaked had not consented to their images and voices being used for the commercials.
A Self-Driving Cruise Robot Taxi Reportedly Struck and Dragged a Pedestrian 20 Feet
Cruise has settled for between $8 million and $12 million with a pedestrian dragged by one of its autonomous vehicles in October 2023. The incident, where the pedestrian was initially hit by a human-driven car and then dragged 20 feet by the Cruise vehicle, led to the suspension of Cruise's operations and increased regulatory scrutiny.
Robin Williams's Voice Deepfaked Without Consent
Zelda Williams, the daughter of the late Robin Williams, condemned the misuse of her father's voice in AI-generated productions, having cited some instances where his voice had been deepfaked, along with the potential for further misuse, as such instances do not involve consent.
Ottawa Couple Reportedly Loses CA$177,023 After Purported Deepfake Elon Musk Investment Scam
A retired Ottawa couple, Doug and Victoria Lloyd, lost CA$177,023 after being lured by a purported deepfake video of Elon Musk promoting a fake investment platform. The deepfake allegedly led to prolonged social engineering, remote access to their computer, and fraudulent cryptocurrency transfers. The couple reportedly suffered major financial loss and ongoing debt. Police say recovery is unlikely.
Anthropic Allegedly Copied Copyrighted Song Lyrics Without Permission to Train Claude
Music publishers alleged that Anthropic copied copyrighted song lyrics without permission to train Claude and that Claude reproduced protected lyrics in its outputs. Anthropic denied infringement and has argued that its training use is fair use. Publishers alleged that the conduct deprived rightsholders and songwriters of licensing control and revenue and undermined markets for licensed lyrics.
Gannett Halts AI-Generated High School Sports Articles After Series of Errors and Public Backlash
Gannett, a newspaper chain, temporarily halted its AI experiment that used a tool called LedeAI to generate high school sports articles. The decision came after several articles produced by the AI showed glaring errors, repetitive language, and awkward phrasing, drawing criticism and mockery on social media.
Peppermill Casino Facial Recognition System Reportedly Misidentified Individual, Leading to Wrongful Arrest in Reno
Purported facial recognition technology deployed at Reno's Peppermill Casino reportedly misidentified Jason Killinger as an individual previously banned from the venue. Casino security reportedly detained Killinger and contacted police, leading to his arrest by the Reno PD. He was reportedly held for 11 hours, including several hours in handcuffs, before fingerprinting reportedly confirmed the misidentification. The incident resulted in alleged physical injury and civil liberties harms.
Purported Deepfake Technology Was Reportedly Used to Generate Naked Pictures of Underage Girls in Spanish Town
In Spain, an AI app was used to digitally alter photos of young girls, making them appear naked. This manipulation sparked an investigation after these images were circulated in Almendralejo, a town in the Extremadura region, raising serious concerns about digital privacy violations and the potential spread of these images on pornographic sites.
Teen's Overdose Reportedly Linked to Meta's AI Systems Failing to Block Ads for Illegal Drugs
Meta's AI moderation systems reportedly failed to block ads for illegal drugs on Facebook and Instagram, allowing users to access dangerous substances. The system's failure is linked to the overdose death of Elijah Ott, a 15-year-old boy who sought drugs through Instagram.
Deepfake Video of Ron DeSantis Dropping Out of 2024 Presidential Race Circulating
In early September 2023, a deepfake video created by C3PMeme circulated on social media, showing Ron DeSantis falsely claiming he was dropping out of the 2024 presidential race. DeSantis did not actually suspend his campaign until January 21, 2024.
Voice deepfake targets bank in failed transfer scam
In spring 2023, Florida investor Clive Kabatznik became the target of an advanced scam attempt involving a voice deepfake mimicking his own voice. The fraudulent caller, using AI-generated speech, contacted Kabatznik's Bank of America representative in an unsuccessful attempt to deceive the banker into transferring funds to a different account.