ExplainabilityTransparencyTrustworthinesscs.HC
Leveraging Rationales to Improve Human Task Performance
Devleena Das, Sonia Chernova
February 11, 2020
International Conference on Intelligent User Interfaces
59 citations
6 influential
Key Takeaways
-
AI explanations can improve human performance, not just transparency: The study demonstrates that when AI systems explain their reasoning through "rationales," humans using those systems perform significantly better at the task—in this case, chess—suggesting that explainability serves a dual purpose beyond mere transparency.
-
Rationales work as a teaching tool: The research shows that automatically generated explanations from an AI's internal decision-making process can function as instructional material, helping humans learn and improve their own skills rather than simply deferring to the AI's superior performance.
-
This approach bridges the human-AI performance gap: Rather than accepting that AI will outperform humans, this work suggests a collaborative model where AI explanations actively elevate human capability, potentially creating a more balanced partnership between human and machine intelligence.
-
The method is generalizable beyond chess: While tested in chess, the Rationale-Generating Algorithm represents a technique that could theoretically be applied across many domains where AI systems exceed human performance, from medical diagnosis to legal analysis, making it relevant to responsible AI deployment broadly.
-
Responsible AI design should prioritize human development: The findings suggest that when deploying superior AI systems, organizations should consider not just accuracy and efficiency, but whether the system's design actively helps humans learn and improve—a key consideration for long-term human-AI collaboration.