ExplainabilityAccountabilityTrustworthinesscs.LG
Interval Abstractions for Robust Counterfactual Explanations
Junqi Jiang, Francesco Leofante, Antonio Rago, Francesca Toni
April 21, 2024
Artificial Intelligence
17 citations
Key Takeaways
-
Counterfactual explanations can become unreliable after model updates: The paper identifies a critical problem—explanations that tell users how to change their circumstances to get a better outcome from an AI system often stop working when the underlying model is retrained or adjusted, even slightly. This undermines trust in AI systems that are regularly updated.
-
The research provides mathematical guarantees for explanation robustness: Rather than testing explanations against a few retrained models, the authors developed a technique using "interval abstractions" that can verify whether an explanation will remain valid across an infinite set of possible model changes, providing exhaustive robustness guarantees instead of just empirical estimates.
-
A new standard for trustworthy recourse recommendations: The paper formalizes a concept called "Δ-robustness" that defines what it means for counterfactual explanations to be reliable under model changes. This creates a measurable standard that AI developers can use to ensure their recourse systems remain trustworthy over time.
-
The approach works with real-world AI systems: The authors tested their method on both neural networks and logistic regression models, demonstrating practical applicability beyond theoretical frameworks, and benchmarked their approach against eleven existing methods for generating explanations.
-
Addresses a gap between research and practice: Existing methods for improving explanation robustness were mostly heuristic without formal guarantees. This work bridges that gap by providing a principled, mathematically-grounded approach that practitioners can use to build more reliable AI systems.