ExplainabilityTrustworthinessTransparencyq-bio.QM
Dermatologist-like explainable AI enhances trust and confidence in diagnosing melanoma
Tirtha Chanda, Katja Hauser, Sarah Hobelsberger, Tabea-Clara Bucher, Carina Nogueira Garcia, Christoph Wies, Harald Kittler, Philipp Tschandl, Cristian Navarrete-Dechent, Sebastian Podlipnik, Emmanouil Chousakos, Iva Crnaric, Jovana Majstorovic, Linda Alhajwan, Tanya Foreman, Sandra Peternel, Sergei Sarap, İrem Özdemir, Raymond L. Barnhill, Mar Llamas Velasco, Gabriela Poch, Sören Korsing, Wiebke Sondermann, Frank Friedrich Gellrich, Markus V. Heppt, Michael Erdmann, Sebastian Haferkamp, Konstantin Drexler, Matthias Goebeler, Bastian Schilling, Jochen S. Utikal, Kamran Ghoreschi, Stefan Fröhling, Eva Krieghoff-Henning, Titus J. Brinker
March 17, 2023
Nature Communications
179 citations
9 influential
Key Takeaways
-
Explainability builds trust in AI medical tools: The study found that dermatologists' trust in an AI system and confidence in their diagnoses significantly increased when the system provided clear explanations for its recommendations, compared to a conventional AI system without explanations.
-
AI explanations should match how experts think: The XAI system's explanations were "highly aligned with clinicians' explanations," suggesting that AI systems are more likely to be adopted when they explain their reasoning in ways that match how medical professionals actually approach diagnosis.
-
Transparency matters more than accuracy alone: While the XAI system showed only numerical (not statistically significant) improvements in diagnostic accuracy, clinicians were still willing to adopt it because of the increased transparency—demonstrating that explainability is valued independently of raw performance gains.
-
Domain-specific explanations are essential: The researchers emphasized that most existing explainability methods fail to provide "precisely located domain-specific explanations," highlighting that generic AI explanations are insufficient for specialized fields like medicine where clinicians need to understand where and why the AI identified specific features.
-
Clinician acceptance is critical for real-world AI deployment: The study demonstrates that even accurate AI systems face adoption barriers without explainability, suggesting that responsible AI development in healthcare must prioritize transparency and clinician buy-in alongside technical performance.