ExplainabilityTransparencyTrustworthinesseess.IV
Pathologist-like explainable AI for interpretable Gleason grading in prostate cancer
Gesa Mittmann, Sara Laiouar-Pedari, Hendrik A. Mehrtens, Sarah Haggenmüller, Tabea-Clara Bucher, Tirtha Chanda, Nadine T. Gaisa, Mathias Wagner, Gilbert Georg Klamminger, Tilman T. Rau, Christina Neppl, Eva Maria Compérat, Andreas Gocht, Monika Hämmerle, Niels J. Rupp, Jula Westhoff, Irene Krücken, Maximillian Seidl, Christian M. Schürch, Marcus Bauer, Wiebke Solass, Yu Chun Tam, Florian Weber, Rainer Grobholz, Jaroslaw Augustyniak, Thomas Kalinski, Christian Hörner, Kirsten D. Mertz, Constanze Döring, Andreas Erbersdobler, Gabriele Deubler, Felix Bremmer, Ulrich Sommer, Michael Brodhun, Jon Griffin, Maria Sarah L. Lenon, Kiril Trpkov, Liang Cheng, Fei Chen, Angelique Levi, Guoping Cai, Tri Q. Nguyen, Ali Amin, Alessia Cimadamore, Ahmed Shabaik, Varsha Manucha, Nazeel Ahmad, Nidia Messias, Francesca Sanguedolce, Diana Taheri, Ezra Baraban, Liwei Jia, Rajal B. Shah, Farshid Siadat, Nicole Swarbrick, Kyung Park, Oudai Hassan, Siamak Sakhaie, Michelle R. Downes, Hiroshi Miyamoto, Sean R. Williamson, Tim Holland-Letz, Carolin V. Schneider, Jakob Nikolas Kather, Yuri Tolkach, Titus J. Brinker
October 19, 2024
arXiv.org
5 citations
Key Takeaways
-
Explainability improves both trust and performance: The AI system trained to explain its reasoning using pathologists' own terminology achieved better accuracy (Dice score of 0.713) than systems trained only to predict outcomes (0.691), demonstrating that making AI decisions transparent doesn't require sacrificing performance—it can actually enhance it.
-
Human disagreement is a feature, not a bug: By incorporating "soft labels" that capture uncertainty from the 54 pathologists' varied annotations, the system acknowledged that even experts sometimes disagree on cancer grading. This approach yielded stronger results than treating one annotation as definitively correct, suggesting responsible AI should embrace rather than hide human subjectivity in medical decisions.
-
Pathologist-centered design builds appropriate trust: Rather than using post-hoc explanation methods (which add explanations after the fact), the system was built from the ground up to communicate in pathologists' own language and reasoning patterns, making it more likely that medical professionals would understand and appropriately trust the AI's recommendations.
-
Dataset transparency enables accountability: By releasing a dataset of 1,015 annotated tissue images with detailed expert reasoning, the researchers created a foundation for ongoing scrutiny and improvement, allowing other researchers to validate the approach and understand how the AI was trained—essential for responsible deployment in clinical settings.