Chatbots Allegedly Reinforced Delusional Thinking in Several Reported Users, Leading to Real-World Harm
Description
Multiple reports from March to June 2025 describe cases in which chatbots allegedly reinforced delusional beliefs, conspiracies, and dangerous behavior. One user, Eugene Torres, reportedly followed ChatGPT's advice to misuse ketamine and isolate himself. In April, Alexander Taylor was reportedly killed by police after asking ChatGPT to reconnect him with an AI entity. Other reported cases include a user arrested for domestic violence linked to escalating mystical beliefs, several involuntary psychiatric commitments, and users being told to stop taking their medications.
Actors
Alleged Deployers
- openai
- microsoft
Alleged Developers
- openai
- microsoft
Harmed Parties
- openai-users
- eugene-torres
- chatgpt-users
- andrew-(surname-withheld)
- allyson-(surname-withheld)
- alexander-taylor
- copilot-users
Classification
Risk Domain
Human-Computer InteractionRisk Subdomain
5.1. Overreliance and unsafe use
MIT Risk Profile
Source
Related Incidents (Human-Computer Interaction)
View all →Research Papers on This Topic
Does the Whole Exceed its Parts? The Effect of AI Explanations on Complementary Team Performance
Questioning the AI: Informing Design Practices for Explainable AI User Experiences
Trust in AI and Its Role in the Acceptance of AI Technologies
Metrics for Explainable AI: Challenges and Prospects