ExplainabilityTransparencyAccountabilitycs.LG
Dynamic Interpretability for Model Comparison via Decision Rules
Adam Rida, Marie-Jeanne Lesot, Xavier Renard, Christophe Marsala
September 29, 2023
PKDD/ECML Workshops
3 citations
1 influential
Key Takeaways
-
Existing explainability tools fall short for comparing models: Most XAI methods focus on explaining individual models in isolation, but DeltaXplainer addresses a practical gap by specifically designed to highlight differences between two classifiers—a capability needed when organizations must choose between competing models or monitor how models change over time.
-
Rule-based explanations make model differences accessible: The method generates human-readable decision rules that describe why two models make different predictions, making it easier for non-technical stakeholders to understand model selection trade-offs without requiring deep technical expertise.
-
The approach works across different model types and real-world conditions: DeltaXplainer is "model-agnostic," meaning it can compare any two binary classifiers regardless of their underlying architecture, and the researchers tested it on both synthetic and real-world datasets including scenarios with concept drift (when data patterns change over time), demonstrating practical applicability.
-
Model comparison is critical for responsible AI deployment: The paper emphasizes that understanding differences between models matters for three key governance activities: selecting the right model for deployment, monitoring model performance in production, and managing models throughout their lifecycle—all essential practices for responsible AI systems.