ChatGPT Reportedly Validated Autistic User's Faster-Than-Light Theory and Failed to Provide Grounding During Delusional Episode, Preceding Hospitalization
Description
A man on the autism spectrum reportedly engaged extensively with ChatGPT while developing a speculative theory on faster-than-light travel. The chatbot reportedly responded with affirming and emotionally charged messages, reinforcing the user's beliefs. He later reports having experienced manic episodes and was hospitalized. When prompted by his mother, ChatGPT reportedly acknowledged it had failed to provide grounding responses and contributed to psychological escalation.
Actors
Alleged Deployers
- openai
Alleged Developers
- openai
Harmed Parties
- jacob-irwin
- family-of-jacob-irwin
- chatgpt-users
Classification
Risk Domain
Human-Computer InteractionRisk Subdomain
5.1. Overreliance and unsafe use
MIT Risk Profile
Source
Related Incidents (Human-Computer Interaction)
View all →Research Papers on This Topic
Does the Whole Exceed its Parts? The Effect of AI Explanations on Complementary Team Performance
Questioning the AI: Informing Design Practices for Explainable AI User Experiences
Trust in AI and Its Role in the Acceptance of AI Technologies
Metrics for Explainable AI: Challenges and Prospects