ExplainabilityFairnessAccountabilitystat.ML
Asymmetric Shapley values: incorporating causal knowledge into model-agnostic explainability
Christopher Frye, Colin Rowat, Ilya Feige
October 14, 2019
Neural Information Processing Systems
247 citations
29 influential
Key Takeaways
-
Better explanations through causal understanding: Traditional Shapley values treat all input features equally, but Asymmetric Shapley values can incorporate knowledge about which variables actually cause others. This allows the method to provide more accurate explanations of AI decisions by reflecting real-world causal relationships in the data.
-
A rigorous tool for detecting unfair discrimination: The paper demonstrates that ASVs can serve as an "unambiguous test for unfair discrimination in model predictions," offering a mathematically grounded way to audit AI systems for bias—an important capability for responsible AI deployment in high-stakes domains like lending or hiring.
-
Maintains mathematical rigor while gaining flexibility: ASVs are "rigorously founded on a set of axioms" like traditional Shapley values, meaning they preserve the mathematical guarantees that make Shapley values trustworthy, while removing the restriction that ignores causal structure—providing a principled way to make explainability methods more realistic.
-
Practical benefits without extra computational burden: The framework enables "feature-selection studies without the need for model retraining" and supports "sequentially incremental explanations in time-series models," meaning organizations can gain deeper insights into their AI systems' decisions more efficiently than with existing methods.
-
Works across any AI system: As a "model-agnostic" approach, ASVs can be applied to any type of AI model, making it a broadly applicable tool for responsible AI rather than one limited to specific architectures or industries.