AI Incidents
Real-world cases where AI systems caused harm, classified by risk domain and entity. Data sourced from
AIID and classified by MIT AI Risk Initiative. CC BY-SA 4.0
8 incidents
Delaware Court Found Krafton Followed Most of ChatGPT's Recommendations in Campaign that Wrongfully Terminated Unknown Worlds Executives and Seized Operational Control
A Delaware Chancery opinion found that, after being warned that firing Unknown Worlds leaders would not eliminate earnout obligations, Krafton's CEO turned to ChatGPT for a "no-deal" strategy and then followed most of its recommendations. The court tied that strategy to Krafton's lockout of publishing control, unilateral public messaging, wrongful termination of Ted Gill, Charlie Cleveland, and Max McGuire, and seizure of studio control.
Student Reportedly Files Complaint Over Professor's Undisclosed Use of Generative AI at Northeastern University
A student at Northeastern University reportedly filed a complaint after discovering that a professor had used generative AI tools, including ChatGPT, to produce course materials despite university policies discouraging undisclosed AI use. The student alleged hypocrisy, citing a syllabus that barred unauthorized AI use by students. The professor acknowledged having used AI-generated materials and expressed regret over not reviewing them more carefully. No tuition refund was reportedly granted.
Vanderbilt Peabody Office's Purportedly ChatGPT-Drafted Message About Michigan State Shooting Reportedly Drew Student Backlash
On February 16, 2023, Vanderbilt University's Peabody College Office of Equity, Diversity and Inclusion reportedly sent students a message about the Michigan State University shooting that disclosed it had been drafted or paraphrased using ChatGPT. Students reportedly criticized the message as impersonal and disrespectful in a moment of grief. Peabody later apologized for "poor judgment," and two EDI deans temporarily stepped back during a review.
Users Reported Abrupt Behavior Changes of Their AI Replika Companions
Replika paid-subscription users reported unusual and sudden changes to behaviors of their "AI companions" such as forgetting memories with users or rejecting their sexual advances, which affected their connections and mental health.
Tesla Driver Put Car on Autopilot Before Falling Asleep in Germany
A Tesla driver fell asleep on an Autobahn near Bamberg, Germany after activating his vehicle's Autopilot mode, which did not respond to attempts to pull it over by the police.
Startup Misled Research Participants about GPT-3 Use in Mental Healthcare Support
OpenAI's GPT-3 was deployed by a mental health startup without ethical review to support peer-to-peer mental healthcare, and whose interactions with the help providers were "deceiving" for research participants.
California Police Turned on Music to Allegedly Trigger Instagram’s DCMA to Avoid Being Live-Streamed
A police officer in Beverly Hills played copyrighted music on his phone when realizing that his interactions were being recorded on a livestream, allegedly hoping the Instagram's automated copyright detection system to end or mute the stream.
Hawaii Police Deployed Robot Dog to Patrol a Homeless Encampment
Honolulu Police Department spent federal pandemic relief funds on a robot dog to take body temperatures and patrol a homeless quarantine encampment which local civil rights advocates criticized as dehumanizing.