ExplainabilityTransparencyTrustworthinesscs.CV
Interpretable Compositional Convolutional Neural Networks
Wen Shen, Zhihua Wei, Shikun Huang, Binbin Zhang, Jiaqi Fan, Ping Zhao, Quanshi Zhang
July 9, 2021
International Joint Conference on Artificial Intelligence
45 citations
6 influential
Key Takeaways
-
Neural networks can be redesigned to show their reasoning: The paper demonstrates that traditional "black box" CNNs can be modified so that their internal filters learn to represent specific, meaningful visual patterns (like object parts or regions) rather than abstract features, making it possible to see what the network is actually looking for when making decisions.
-
Interpretability doesn't require extra labeled data: A key advantage of this compositional approach is that it achieves interpretability using only image labels for training—it doesn't need additional annotations identifying specific parts or regions, making it more practical to implement at scale.
-
The method is broadly applicable: The authors note their approach "can be broadly applied to different types of CNNs," suggesting this interpretability technique isn't limited to one architecture and could potentially become a standard practice across different neural network designs.
-
Meaningful interpretability is technically achievable: By ensuring each filter "consistently represents a specific compositional object part or image region with a clear meaning," the paper addresses a fundamental challenge in explainable AI—moving beyond vague explanations toward genuinely understandable representations of how AI systems make decisions.