ExplainabilityTransparencyTrustworthinesscs.CV
AS-XAI: Self-supervised Automatic Semantic Interpretation for CNN
Changqi Sun, Hao Xu, Yuntian Chen, Dongxiao Zhang
December 2, 2023
arXiv.org
3 citations
Key Takeaways
-
Automatic explanations without human input: AS-XAI can generate explanations for AI decisions automatically using mathematical techniques (orthogonal embedding and PCA), eliminating the need for humans to manually label or interpret model behavior, which makes the approach more scalable and practical.
-
Addresses three critical interpretability challenges: The framework tackles reliability (consistent explanations), causality (understanding why decisions are made), and usability (explanations people can actually understand)—three factors the authors identify as essential but often missing in existing explainability methods.
-
Works across different scenarios: The method can provide explanations for unfamiliar categories the model hasn't seen before (out-of-distribution cases) and help distinguish between similar objects, suggesting the approach generalizes beyond its training data.
-
No additional computational burden: Unlike many explainability techniques that require extra processing power, AS-XAI generates interpretable insights without increasing computational costs, making it more feasible for real-world deployment in resource-constrained settings.
-
Measures model sensitivity to concepts: By analyzing how model filters respond to different semantic concepts, AS-XAI can reveal which visual features the AI actually relies on for decisions, providing insight into potential biases or unexpected decision-making patterns.