ExplainabilitySafetyTransparencycs.AI
On the explainable properties of 1-Lipschitz Neural Networks: An Optimal Transport Perspective
Mathieu Serrurier, Franck Mamalet, Thomas Fel, Louis Béthune, Thibaut Boissin
June 14, 2022
Neural Information Processing Systems
11 citations
2 influential
Key Takeaways
-
1-Lipschitz neural networks produce significantly clearer and less noisy saliency maps compared to traditional neural networks, with the paper demonstrating that these visual explanations are "highly concentrated on the essential parts of the image with low noise" and outperform existing explanation methods across multiple evaluation metrics.
-
These improved explanations align better with human judgment: The research proves that saliency maps from 1-Lipschitz networks "align unprecedentedly well with human explanations on ImageNet," suggesting the AI system's reasoning process is more interpretable to people reviewing its decisions.
-
Robustness and explainability are connected through mathematical optimization: The paper shows that training these networks with optimal transport loss simultaneously optimizes both classification accuracy and the quality of explanations, meaning models built to be adversarially robust (resistant to attacks) naturally produce more trustworthy saliency maps.
-
Counterfactual explanations become more meaningful: Following the gradient in these networks no longer represents an adversarial attack but rather a "counterfactual explanation that explicitly transports the input from one class to another," providing users with concrete examples of how to change an input to get a different decision.
-
This approach offers built-in certification of robustness: The paper notes these networks are "certifiably robust by design," meaning organizations can provide formal guarantees about model reliability alongside improved explanations—addressing two key responsible AI concerns simultaneously.