Incident #21·AI Safety & Failures
Tougher Turing Test Exposes Chatbots’ Stupidity (migrated to Issue)
Explainability
Description
The 2016 Winograd Schema Challenge highlighted how even the most successful AI systems entered into the Challenge were only successful 3% more often than random chance. This incident has been downgraded to an issue as it does not meet current ingestion criteria.
Actors
Alleged Deployers
- researchers
Alleged Developers
- researchers
Harmed Parties
- researchers
Classification
Risk Domain
AI Safety & FailuresRisk Subdomain
7.3. Lack of capability or robustness
MIT Risk Profile
OtherOtherOther
Topics
Explainability
Source
Related Incidents (AI Safety & Failures)
View all →Research Papers on This Topic
View all →Concrete Problems in AI Safety
3,612 citationsJun 2016
A Survey on Explainable Artificial Intelligence (XAI): Towards Medical XAI
2,338 citationsJul 2019
Representation Engineering: A Top-Down Approach to AI Transparency
1,499 citationsOct 2023
Explainable artificial intelligence (XAI) in deep learning-based medical image analysis
1,178 citationsJul 2021
Mitigation Tools
Tools related to this risk domain, via shared responsible AI topics.