Incident #646·Human-Computer Interaction
Snapchat's Algorithm Alleged to Link Minor with Sex Offenders
Description
A judge ruled Snapchat not liable under Section 230 after its algorithm connected a minor with convicted sex offenders on multiple occasions, leading to sexual assaults first in 2019 and again in 2021. The platform's "Quick Add" feature was implicated in facilitating the connections between the minor and the offenders.
Actors
Alleged Deployers
- snapchat
Alleged Developers
- snapchat
Harmed Parties
- minors
Classification
Risk Domain
Human-Computer InteractionRisk Subdomain
5.1. Overreliance and unsafe use
MIT Risk Profile
AIUnintentionalPost-deployment
Source
Related Incidents (Human-Computer Interaction)
View all →Research Papers on This Topic
Does the Whole Exceed its Parts? The Effect of AI Explanations on Complementary Team Performance
1,136 citationsJun 2020
Questioning the AI: Informing Design Practices for Explainable AI User Experiences
1,075 citationsJan 2020
Trust in AI and Its Role in the Acceptance of AI Technologies
957 citationsMar 2022
Metrics for Explainable AI: Challenges and Prospects
944 citationsDec 2018