ExplainabilityTransparencyAccountabilitycs.LG
Exact Computation of Any-Order Shapley Interactions for Graph Neural Networks
Maximilian Muschalik, Fabian Fumagalli, Paolo Frazzetto, Janine Strotherm, Luca Hermes, Alessandro Sperduti, Eyke Hüllermeier, Barbara Hammer
January 28, 2025
International Conference on Learning Representations
16 citations
2 influential
Key Takeaways
-
Making GNN decisions understandable: This paper addresses a significant gap in AI transparency by developing methods to explain how Graph Neural Networks make predictions. Since GNNs are increasingly used in real-world applications like drug discovery and social network analysis, understanding their decision-making process is crucial for responsible deployment.
-
Going beyond individual feature importance: While traditional explanation methods (Shapley Values) only show how individual data points contribute to a prediction, this work extends to "Shapley Interactions," revealing how groups of nodes work together to influence outcomes. This is important because real-world decisions often depend on complex interactions rather than isolated factors.
-
Making explanations computationally practical: The paper's key innovation is reducing the computational burden of generating exact explanations. By exploiting the structure of how GNNs process graph data, GraphSHAP-IQ makes it feasible to compute detailed explanations that were previously too expensive to calculate, bringing responsible AI practices closer to real-world feasibility.
-
Maintaining accuracy in explanations: The authors demonstrate that their approach produces exact (not approximate) explanations on benchmark datasets, which is important for high-stakes applications where approximate explanations could mislead stakeholders about why an AI system made a particular decision.
-
Applicable to widely-used GNN architectures: GraphSHAP-IQ works with popular message-passing GNN techniques, meaning the transparency improvements can be integrated into existing systems rather than requiring complete redesigns.