ExplainabilityTransparencyAccountabilitystat.ML
Contrastive Explanations with Local Foil Trees
Jasper van der Waa, Marcel Robeer, Jurriaan van Diggelen, Matthieu Brinkhuis, Mark Neerincx
June 19, 2018
International Conference on Machine Learning
90 citations
5 influential
Key Takeaways
-
Contrastive explanations are more practical than feature importance alone: The paper demonstrates that asking "why this prediction instead of that one?" reduces the number of features needed to explain a decision, making explanations feasible even in high-dimensional datasets where listing all important features becomes overwhelming.
-
The method aligns with how humans naturally ask questions: By formalizing the human tendency to seek contrastive explanations (comparing an actual outcome against an alternative), the approach creates AI explanations that match intuitive reasoning patterns, potentially improving user understanding and trust.
-
Local decision trees can identify decision boundaries: The proposed method uses locally trained one-versus-all decision trees to pinpoint specific rules that distinguish between the predicted outcome (the "fact") and alternative outcomes (the "foil"), providing concrete, rule-based explanations rather than abstract feature scores.
-
Practical applicability demonstrated across multiple tasks: The authors validated their approach on three benchmark classification tasks, suggesting the method has potential generalizability beyond single-use cases, though real-world deployment would require further testing.
-
Addresses a key XAI limitation: This work tackles a genuine problem in explainable AI—that high-dimensional feature importance explanations can be too complex for stakeholders to act on—by focusing explanations only on features relevant to specific decision contrasts.