Incident #723·Human-Computer Interaction
Instagram Algorithms Reportedly Directed Children's Merchandise Ad Campaign to Adult Men and Sex Offenders
Description
An Instagram ad campaign for children's merchandise was intended to reach adult women but was instead predominantly shown to adult men, including convicted sex offenders, due to Instagram's algorithmic targeting. This failure is reported to have led to direct solicitations for sex with a 5-year-old model in the ads.
Actors
Alleged Deployers
- meta
Alleged Developers
- meta
Harmed Parties
- instagram-users
- instagram-sellers
- minors
Classification
Risk Domain
Human-Computer InteractionRisk Subdomain
5.1. Overreliance and unsafe use
MIT Risk Profile
AIUnintentionalPost-deployment
Source
Related Incidents (Human-Computer Interaction)
View all →Research Papers on This Topic
Does the Whole Exceed its Parts? The Effect of AI Explanations on Complementary Team Performance
1,136 citationsJun 2020
Questioning the AI: Informing Design Practices for Explainable AI User Experiences
1,075 citationsJan 2020
Trust in AI and Its Role in the Acceptance of AI Technologies
957 citationsMar 2022
Metrics for Explainable AI: Challenges and Prospects
944 citationsDec 2018