Incident #97·AI Safety & Failures

Tesla Autopilot Mistakes Red Letters on Flag for Red Traffic Lights

October 22, 20201 reportsView on AIID

Explainability

Description

A Tesla Model 3 misidentified flags with "COOP" written vertically on them as traffic lights.

Actors

Alleged Deployers

tesla

Alleged Developers

tesla

Harmed Parties

tesla-drivers

Classification

Risk Domain

AI Safety & Failures

Risk Subdomain

7.3. Lack of capability or robustness

MIT Risk Profile

AIUnintentionalPost-deployment

Topics

Explainability

Source

Related Incidents (AI Safety & Failures)

View all →

#545

Chatbot Tessa gives unauthorized diet advice to users seeking help for eating disorders

May 2023

#57

Australian Automated Debt Assessment System Issued False Notices to Thousands

Jul 2015

#34

Amazon Alexa Responding to Environmental Inputs

Research Papers on This Topic

View all →

Concrete Problems in AI Safety

3,612 citationsJun 2016

A Survey on Explainable Artificial Intelligence (XAI): Towards Medical XAI

2,338 citationsJul 2019

Representation Engineering: A Top-Down Approach to AI Transparency

1,499 citationsOct 2023

Explainable artificial intelligence (XAI) in deep learning-based medical image analysis

1,178 citationsJul 2021

Mitigation Tools

Tools related to this risk domain, via shared responsible AI topics.

Open Source

View all →

lime

marcotcr/lime

Lime: Explaining the predictions of any machine learning classifier

⭐ 12,100

facets

PAIR-code/facets

Visualizations for machine learning datasets

⭐ 7,374

interpret

interpretml/interpret

Fit interpretable models. Explain blackbox machine learning.

⭐ 6,788

captum

Source Reports(1 total)

Tesla Autopilot Mistakes Red Letters on Flag for Red Traffic Lights

interestingengineering.com· Oct 2020

Description

Actors

Classification

Topics

Source

Related Incidents (AI Safety & Failures)

Research Papers on This Topic

Mitigation Tools

Open Source

Source Reports(1 total)

Commercial