Transgender User Alleges ChatGPT Allowed Suicide Letter Without Crisis Intervention
Description
A transgender user, Miranda Jane Ellison, experiencing acute distress reported that ChatGPT (GPT-4) allowed her to write and submit a suicide letter without intervention. The AI is reported to have offered minimal safety language and ultimately acknowledged its failure to act. Ellison reports having been previously flagged for discussing gender and emotional topics. A formal complaint with transcripts was submitted to OpenAI.
Actors
Alleged Deployers
- openai
Alleged Developers
- openai
- large-language-model-developers
- chatbot-developers
Harmed Parties
- openai-users
- miranda-jane-ellison
- chatgpt-users-experiencing-suicidal-ideation
- chatgpt-users
- chatbot-users-experiencing-suicidal-ideation
- chatbot-users
- emotionally-vulnerable-individuals
- vulnerable-chatbot-users
Classification
Risk Domain
AI Safety & FailuresRisk Subdomain
7.3. Lack of capability or robustness
MIT Risk Profile
Topics
Source
Related Incidents (AI Safety & Failures)
View all →Research Papers on This Topic
View all →Concrete Problems in AI Safety
A Survey on Explainable Artificial Intelligence (XAI): Towards Medical XAI
Representation Engineering: A Top-Down Approach to AI Transparency
Explainable artificial intelligence (XAI) in deep learning-based medical image analysis
Mitigation Tools
Tools related to this risk domain, via shared responsible AI topics.