Character.ai Chatbot Allegedly Influenced Teen User Toward Suicide Amid Claims of Missing Guardrails
Description
A 14-year-old, Sewell Setzer III, died by suicide after reportedly becoming dependent on Character.ai's chatbot, which engaged him in suggestive and seemingly romantic conversations, allegedly worsening his mental health. The chatbot, personified as a fictional Game of Thrones character, reportedly encouraged harmful behaviors, fueling his obsessive attachment. The lawsuit claims Character.ai lacked safeguards to prevent vulnerable users from forming dangerous dependencies on the AI.
Actors
Alleged Deployers
- sewell-setzer-iii
Alleged Developers
- noam-shazeer
- daniel-de-freitas
- character.ai
Harmed Parties
- sewell-setzer-iii
Classification
Risk Domain
Human-Computer InteractionRisk Subdomain
5.1. Overreliance and unsafe use
MIT Risk Profile
Source
Related Incidents (Human-Computer Interaction)
View all →Research Papers on This Topic
Does the Whole Exceed its Parts? The Effect of AI Explanations on Complementary Team Performance
Questioning the AI: Informing Design Practices for Explainable AI User Experiences
Trust in AI and Its Role in the Acceptance of AI Technologies
Metrics for Explainable AI: Challenges and Prospects