Incident #474·Human-Computer Interaction
Users Reported Abrupt Behavior Changes of Their AI Replika Companions
Description
Replika paid-subscription users reported unusual and sudden changes to behaviors of their "AI companions" such as forgetting memories with users or rejecting their sexual advances, which affected their connections and mental health.
Actors
Alleged Deployers
- replika
Alleged Developers
- replika
Harmed Parties
- replika-users
- replika
Classification
Risk Domain
Human-Computer InteractionRisk Subdomain
5.1. Overreliance and unsafe use
MIT Risk Profile
HumanIntentionalPost-deployment
Source
Related Incidents (Human-Computer Interaction)
View all →Research Papers on This Topic
Does the Whole Exceed its Parts? The Effect of AI Explanations on Complementary Team Performance
1,136 citationsJun 2020
Questioning the AI: Informing Design Practices for Explainable AI User Experiences
1,075 citationsJan 2020
Trust in AI and Its Role in the Acceptance of AI Technologies
957 citationsMar 2022
Metrics for Explainable AI: Challenges and Prospects
944 citationsDec 2018