ExplainabilityTransparencyAccountabilitycs.CV
Looking in the Right place for Anomalies: Explainable AI through Automatic Location Learning
Satyananda Kashyap, Alexandros Karargyris, Joy Wu, Yaniv Gur, Arjun Sharma, Ken C. L. Wong, Mehdi Moradi, Tanveer Syeda-Mahmood
August 2, 2020
IEEE International Symposium on Biomedical Imaging
15 citations
1 influential
Key Takeaways
-
Explainability gaps in medical AI are a real barrier to clinical adoption: The paper identifies that current "black box" deep learning systems for detecting anomalies in medical images lack transparency, which creates resistance from clinicians who need to understand and trust AI recommendations before using them in patient care.
-
Standard visualization methods (like heat maps) are insufficient: The research demonstrates that existing explainable AI techniques that show heat maps highlighting important image regions cannot guarantee the AI is actually focusing on the correct anatomical location where an anomaly truly exists, potentially masking flawed reasoning.
-
Automated learning from clinical reports improves reliability: The authors developed a method that automatically extracts location information from radiologists' written reports (e.g., "left lower lobe") and uses this to train the AI system to look in the right anatomical regions, ensuring anomalies are detected where they should be.
-
Combining multiple AI techniques enhances trustworthiness: The approach uses a hybrid system combining text-analysis networks (Bi-LSTM) with image-analysis networks (DenseNet and ResNet) to create more reliable explanations, suggesting that responsible AI may require integrating multiple specialized methods rather than relying on single approaches.
-
This addresses a critical need in high-stakes medical settings: By ensuring AI systems focus on clinically relevant locations and can explain their reasoning, this work tackles a fundamental requirement for deploying AI responsibly in healthcare where diagnostic accuracy and clinician confidence are essential.