ExplainabilityTransparencyTrustworthinesscs.AI
Integrating Prior Knowledge in Post-hoc Explanations
Adulam Jeyasothy, Thibault Laugel, Marie-Jeanne Lesot, Christophe Marsala, Marcin Detyniecki
April 25, 2022
International Conference on Information Processing and Management of Uncertainty
8 citations
Key Takeaways
-
Personalized explanations improve understanding: The paper demonstrates that AI explanations can be tailored to individual users by integrating their existing knowledge into explanation methods, making complex model decisions more understandable to different audiences rather than using one-size-fits-all explanations.
-
A flexible framework for better explanations: The researchers propose a general approach that can be applied to various explanation methods by adding a "compatibility term" to the optimization process, suggesting that prior knowledge integration is a broadly applicable principle rather than limited to specific techniques.
-
Counterfactual explanations become more practical: The paper introduces KICE (Knowledge Integration in Counterfactual Explanation), which generates "what-if" scenarios that align with user knowledge. This makes explanations more relevant—for example, suggesting realistic alternative scenarios rather than implausible ones that users would dismiss.
-
Bridging the gap between AI and human reasoning: By explicitly incorporating what users already know into explanation methods, this work addresses a key challenge in responsible AI: ensuring that explanations actually help people understand and trust AI systems, rather than just providing technical information they cannot relate to.