ExplainabilityTransparencyTrustworthinesscs.LG
Exploiting auto-encoders and segmentation methods for middle-level explanations of image classification systems
Andrea Apicella, Salvatore Giugliano, Francesco Isgrò, Roberto Prevete
June 9, 2021
Knowledge-Based Systems
21 citations
Key Takeaways
-
Multiple explanations are better than one: The paper demonstrates that different types of auto-encoders can extract different "middle-level features" from images, allowing AI systems to provide multiple explanations for the same classification decision rather than a single explanation, which may better match how humans understand decisions.
-
Human-centered explanations matter: The research emphasizes that explanations should be designed with actual human users in mind, moving away from purely technical explanations toward features that are more intuitive and understandable to non-experts reviewing AI decisions.
-
Auto-encoders can bridge the gap between raw data and human understanding: The framework uses auto-encoders to identify intermediate-level features that are more meaningful to humans than raw pixel-level data but more specific than high-level concepts, potentially making AI decision-making more transparent and trustworthy.
-
The approach shows promise across different image datasets: The authors tested their method on two different image datasets with three different types of middle-level features, reporting "encouraging" results that suggest the framework could be practically applied to real-world image classification systems.
-
Potential applications beyond images: While tested on image classification, the authors suggest this XAI framework could potentially be adapted to other data types, indicating broader applicability for explaining AI decisions across different domains.