ExplainabilityTransparencyTrustworthinesscs.AI
An Information Bottleneck Characterization of the Understanding-Workload Tradeoff
Lindsay Sanneman, Mycal Tucker, Julie Shah
October 11, 2023
Conference on Fairness, Accountability and Transparency
15 citations
1 influential
Key Takeaways
-
There's a fundamental tradeoff in AI explanations: More detailed explanations can improve understanding but increase mental workload on users, requiring designers to find the right balance rather than maximize one factor alone.
-
Abstractions are key to better explanations: Grouping related features together into meaningful categories helps people understand AI decisions without overwhelming them—the paper confirms this through human experiments.
-
Information theory can guide practical AI design: The researchers used mathematical principles (Information Bottleneck method) to automatically create these helpful abstractions, suggesting that rigorous mathematical approaches can improve real-world explainability.
-
Human factors must be measured empirically: The paper establishes concrete connections between abstract concepts (informativeness and complexity) and actual human experiences (understanding and workload), showing that responsible AI design requires testing with real people, not just theoretical analysis.
-
Personalized explanations are now more feasible: By mathematically characterizing the workload-understanding tradeoff, the research enables "user-tailored XAI design"—meaning AI systems could potentially adapt explanations to different users' needs and cognitive capacities.