ExplainabilityTransparencyTrustworthinesscs.LG
MEGAN: Multi-Explanation Graph Attention Network
Jonas Teufel, Luca Torresi, Patrick Reiser, Pascal Friederich
November 23, 2022
xAI
10 citations
Key Takeaways
-
Multiple explanations improve interpretability: MEGAN can generate multiple independent explanations for a single prediction, allowing it to distinguish between positive and negative evidence—a capability that existing single-explanation methods lack and that proves particularly valuable for understanding graph regression predictions.
-
Explanations can be directly trained: Unlike previous approaches, MEGAN's fully differentiable architecture enables "explanation-supervised" training, meaning the model can be explicitly taught to produce better explanations rather than having them emerge as a byproduct, achieving "near-perfect explanation accuracy" under this training approach.
-
Strong performance on ground-truth validation: The model was validated on synthetic datasets with known correct explanations, where it "outperforms existing baseline explainability methods" in both single and multi-explanation scenarios, providing evidence that the approach actually identifies the right factors influencing predictions.
-
Real-world explanations align with human judgment: When tested on real-world datasets, MEGAN produced "sparse high-fidelity explanations consistent with human intuition," suggesting the method generates explanations that domain experts would recognize as sensible rather than opaque technical artifacts.
-
Applicable to graph-based AI systems: This work addresses explainability for graph neural networks specifically, which are increasingly used in domains like drug discovery, social networks, and recommendation systems—making this advancement relevant for responsible AI in these high-stakes applications.