ExplainabilityTransparencyAccountabilitycs.LG
Enhancing Counterfactual Explanation Search with Diffusion Distance and Directional Coherence
Marharyta Domnich, Raul Vicente
April 19, 2024
xAI
7 citations
1 influential
Key Takeaways
-
Counterfactual explanations help make AI decisions more understandable by showing what would need to change for a different outcome. This paper addresses a key challenge in responsible AI: helping people understand why an AI system made a particular decision, which is essential for building trust and enabling meaningful human oversight.
-
The research incorporates "diffusion distance" to find more realistic and actionable explanations. Rather than suggesting arbitrary changes to inputs, this approach identifies explanations that follow natural patterns in real-world data, making recommendations more feasible and practical for users to act upon.
-
A new "directional coherence" component ensures explanations are intuitive and consistent with how individual features typically affect outcomes. This addresses a human cognition principle: people find explanations more convincing when changes align with their expectations about how each factor influences results, rather than receiving counterintuitive or contradictory suggestions.
-
The proposed CoDiCE method outperforms existing explanation techniques (DiCE, FACE, Prototypes, and Growing Spheres) in generating counterfactual explanations, suggesting that incorporating human-centered design principles can improve AI explainability tools in practice.
-
This work demonstrates that responsible AI requires understanding human decision-making processes. By grounding technical approaches in how humans naturally produce and evaluate explanations, the research shows that more trustworthy AI systems emerge from human-centered design rather than purely algorithmic optimization.