ExplainabilityTransparencyAccountabilitycs.LG
Riemannian Integrated Gradients: A Geometric View of Explainable AI
Federico Costanza, Lachlan Simpson
March 2, 2025
International Conference on Geometric Science of Information
2 citations
Key Takeaways
-
Explainability methods need to account for data geometry: The paper shows that traditional explanation techniques like Integrated Gradients may not work optimally for complex data structures. By extending these methods to Riemannian manifolds (curved mathematical spaces), the research suggests that AI explanations should be tailored to how data is actually organized, not just treated as flat, simple spaces.
-
Feature attribution can be understood through fundamental mathematical principles: The finding that feature attributions correspond to eigenvalues of a symmetric endomorphism provides a more rigorous mathematical foundation for understanding why AI systems make specific decisions. This deeper mathematical grounding could make explanations more reliable and trustworthy.
-
The work maintains backward compatibility with existing methods: Since RIG "restricts to IG when the Riemannian manifold is Euclidean space," this extension doesn't invalidate current explainability practices but rather generalizes them. This means organizations can adopt more sophisticated explanation methods without abandoning existing tools and workflows.
-
Better explanations for specialized AI applications: This geometric approach is particularly relevant for AI systems working with non-Euclidean data (such as graph neural networks, recommendation systems, or medical imaging). More accurate explanations in these domains could improve trust and accountability in high-stakes applications.