ExplainabilityTransparencyAccountabilityeess.IV
Instance-level quantitative saliency in multiple sclerosis lesion segmentation
Federico Spagnolo, Nataliia Molchanova, Meritxell Bach Cuadra, Mario Ocampo Pineda, Lester Melie-Garcia, Cristina Granziera, Vincent Andrearczyk, Adrien Depeursinge
June 13, 2024
Scientific Reports
4 citations
Key Takeaways
-
AI explanations can now focus on individual lesions rather than just overall predictions: The paper extends explainability methods (SmoothGrad and Grad-CAM++) to provide instance-level explanations for semantic segmentation, meaning doctors can understand why an AI system detected and outlined a specific lesion among multiple lesions, rather than just getting a general explanation of the model's behavior.
-
The AI models learned clinically sensible patterns: The saliency maps revealed that the models primarily relied on FLAIR MRI scans (rather than MPRAGE scans) for detecting white matter lesions in multiple sclerosis patients, and showed positive attention inside lesions with negative attention around their borders—patterns that align with how expert clinicians actually identify these lesions, building confidence in the models' reasoning.
-
Quantitative saliency scores could help identify when AI makes mistakes: The study found that peak saliency values differed significantly between correct and incorrect predictions, suggesting that the strength of the AI's "confidence signals" (measured quantitatively) could potentially be used as a warning system to flag when the model is uncertain about a lesion detection.
-
This approach was tested on real clinical data at scale: The methods were validated on over 4,000 MRI scans from nearly 700 patients with annotations from four expert clinicians, demonstrating practical applicability rather than just theoretical promise in a responsible AI context.