ExplainabilityTransparencyTrustworthinesscs.AI
Backtracking Counterfactuals
Julius von Kügelgen, Abdirisak Mohamed, Sander Beckers
November 1, 2022
CLEaR
30 citations
4 influential
Key Takeaways
-
Counterfactual reasoning has two competing frameworks: The conventional approach (Pearl's interventionist model) assumes causal laws stay fixed while changing circumstances, but emerging evidence from psychology and philosophy suggests humans often use "backtracking"—keeping causal laws the same while imagining different initial conditions led to the observed outcome.
-
Backtracking counterfactuals may better reflect human intuition: The paper notes "ample evidence that humans backtrack," suggesting that AI systems trained only on interventionist counterfactuals may generate explanations that don't align with how people naturally reason about "what if" scenarios, potentially making AI explanations less intuitive or trustworthy.
-
This work formalizes backtracking for the first time in AI: The authors present the first general algorithmic framework for backtracking counterfactuals within structural causal models, filling a gap that could improve how AI systems generate explanations and counterfactual reasoning in responsible AI applications.
-
Implications for explainable AI (XAI): The paper explicitly connects backtracking counterfactuals to XAI, suggesting that AI explanations could be more effective and human-aligned if they incorporate backtracking semantics rather than relying solely on interventionist approaches.
-
Different counterfactual frameworks may be appropriate for different contexts: The formalization of backtracking provides AI developers with an additional tool to choose the most suitable reasoning approach for specific applications, potentially improving the quality and appropriateness of AI-generated explanations.