ExplainabilityTransparencyAccountabilitycs.CV
Accurate Explanation Model for Image Classifiers using Class Association Embedding
Ruitao Xie, Jingbang Chen, Limai Jiang, Rui Xiao, Yi Pan, Yunpeng Cai
June 12, 2024
IEEE International Conference on Data Engineering
12 citations
Key Takeaways
-
The method improves explanation accuracy by combining global and local knowledge: Rather than relying solely on local explanations (which can get trapped in limited perspectives), this approach integrates broader patterns about how classifiers make decisions, leading to more reliable explanations of why images are classified a certain way.
-
Explanations work through realistic "what-if" scenarios: The system generates synthetic images that show what would need to change in a picture for the classifier to make a different decision, while keeping the individual characteristics of the image intact—making explanations more intuitive and actionable than abstract feature maps.
-
The method separates "class-related" features from individual characteristics: By distinguishing between features that determine classification (like "has whiskers" for cats) versus features unique to that specific image (like "brown coloring"), the approach provides clearer insights into what the classifier actually uses to make decisions.
-
Creates a visual map of classification patterns: The extracted features form a low-dimensional space that can be visualized, allowing stakeholders to see the overall decision-making patterns of the classifier rather than just explanations for individual images—useful for auditing potential biases.
-
Addresses a real gap in explainability: The paper identifies that existing explanation methods often struggle with extracting global knowledge about classification tasks, which this work directly tackles—important for applications where understanding systematic patterns matters more than explaining single predictions.