Incident #156·Human-Computer Interaction

Amazon Reportedly Sold Products and Recommended Frequently Bought Together Items That Aid Suicide Attempts

February 4, 20222 reportsView on AIID

Description

Despite complaints notifying Amazon about the sale of various products that had been used to aid suicide attempts, its recommendation system reportedly continued selling them and suggesting their frequently bought-together items.

Actors

Alleged Deployers

amazon

Alleged Developers

amazon

Harmed Parties

people-attempting-suicides

Classification

Risk Domain

Human-Computer Interaction

Risk Subdomain

5.1. Overreliance and unsafe use

MIT Risk Profile

AIUnintentionalPost-deployment

Source

Databaseaiid

LicenseCC BY-SA 4.0

View on AIID

Related Incidents (Human-Computer Interaction)

View all →

#826

Character.ai Chatbot Allegedly Influenced Teen User Toward Suicide Amid Claims of Missing Guardrails

Feb 2024

#67

Sleeping Driver on Tesla AutoPilot

Dec 2018

#17

Inappropriate Gmail Smart Reply Suggestions

Research Papers on This Topic

Does the Whole Exceed its Parts? The Effect of AI Explanations on Complementary Team Performance

1,136 citationsJun 2020

Questioning the AI: Informing Design Practices for Explainable AI User Experiences

1,075 citationsJan 2020

Trust in AI and Its Role in the Acceptance of AI Technologies

957 citationsMar 2022

Metrics for Explainable AI: Challenges and Prospects

944 citationsDec 2018

Source Reports(2 total)

Complaint For Civil Penalties and Demand for a Jury Trial

cdn.arstechnica.net· Sep 2022

Amazon's algorithm suggests products for suicide attempts

nytimes.com· Feb 2022