ExplainabilityBiasFairnessstat.ML
PWSHAP: A Path-Wise Explanation Model for Targeted Variables
Lucile Ter-Minassian, Oscar Clivio, Karla Diaz-Ordaz, Robin J. Evans, Chris Holmes
June 26, 2023
International Conference on Machine Learning
6 citations
Key Takeaways
-
PWSHAP enables targeted transparency for high-stakes decisions: The method specifically addresses a gap in existing AI explanation tools by focusing on how a single variable of special interest (like a medical treatment or demographic factor) affects model predictions, making it more useful for auditing bias and fairness in sensitive domains like healthcare and policy.
-
The approach combines causal reasoning with explainability: By incorporating user-defined causal diagrams (DAGs) alongside Shapley values, PWSHAP can distinguish between direct effects and indirect effects through different causal pathways, helping stakeholders understand how a variable influences outcomes, not just that it does.
-
Mathematical safeguards provide reliability: The authors establish formal error bounds for their method's calculations, and demonstrate robustness against adversarial attacks—important assurances when these explanations will inform consequential decisions affecting people's lives.
-
Local bias detection becomes more precise: PWSHAP can perform mediation analysis and identify effect modification at the individual level, meaning organizations can detect whether a model's bias or treatment effects vary across different groups or circumstances, rather than only seeing aggregate patterns.
-
Real-world validation demonstrates practical applicability: The paper includes a real-world experiment alongside theoretical examples, suggesting the method can actually be implemented in practice to audit deployed models for fairness and transparency concerns.