ExplainabilityTrustworthinessSafetyeess.IV
Explaining Uncertainty in Multiple Sclerosis Cortical Lesion Segmentation Beyond Prediction Errors
Nataliia Molchanova, Pedro M. Gordaliza, Alessandro Cagol, Mario Ocampo--Pineda, Po--Jui Lu, Matthias Weigel, Xinjie Chen, Erin S. Beck, Haris Tsagkas, Daniel Reich, Anna Stölting, Pietro Maggi, Delphine Ribes, Adrien Depeursinge, Cristina Granziera, Henning Müller, Meritxell Bach Cuadra
April 7, 2025
Key Takeaways
-
Uncertainty in AI medical imaging reflects real clinical challenges, not just model failures: The study found that AI uncertainty about lesion detection correlates with factors like lesion size and shape—the same factors that make human experts less confident. This suggests uncertainty quantification can reveal genuinely difficult cases rather than simply flagging broken predictions.
-
Deep ensembles provide interpretable uncertainty for clinical use: By using multiple AI models working together, researchers created uncertainty estimates that clinicians could understand and act upon. Expert radiologists confirmed these uncertainty patterns matched their own diagnostic reasoning, making the AI's "doubt" clinically meaningful.
-
Framework tested across different real-world conditions: The research validated their approach on nearly 2,000 lesions across two datasets and tested how well it worked when AI encountered new, unfamiliar data patterns—demonstrating practical robustness beyond controlled laboratory settings.
-
Trustworthy AI requires moving beyond accuracy metrics: Rather than only measuring whether predictions were right or wrong, this work emphasizes understanding why the AI is uncertain. This shift is crucial for healthcare, where clinicians need to know not just what the AI thinks, but how confident it should be.
-
Lesion characteristics matter more than we might assume: The strong relationship between uncertainty and physical lesion properties (size, shape, location) suggests that improving AI performance may require domain-specific solutions rather than generic technical fixes.