ExplainabilityTrustworthinessTransparencyeess.IV
Demystifying Deep Learning Models for Retinal OCT Disease Classification using Explainable AI
Tasnim Sakib Apon, Mohammad Mahmudul Hasan, Abrar Islam, MD. Golam Rabiul Alam
November 6, 2021
2021 IEEE Asia-Pacific Conference on Computer Science and Data Engineering (CSDE)
23 citations
Key Takeaways
-
Explainability is critical for clinical adoption: The paper demonstrates that adding explainable AI techniques (specifically LIME) to deep learning models helps medical professionals understand why the AI makes specific diagnoses for retinal diseases, addressing the "black box" problem that currently prevents doctors from fully trusting AI recommendations in real-world settings.
-
Simpler, smaller models can be more practical: The researchers developed a smaller and simpler CNN model compared to existing approaches, which requires less computational power and memory while maintaining accuracy—making the technology more feasible for real-time clinical applications rather than requiring expensive, resource-intensive infrastructure.
-
Interpretability reduces clinical risk: By making AI decisions transparent and interpretable, the model helps reduce "opacity and vulnerability" in medical AI systems, enabling doctors to verify the AI's reasoning and catch potential errors before they affect patient care decisions.
-
Current deep learning models have significant limitations for medical use: The paper identifies three key barriers to clinical implementation: lack of interpretability, insufficient precision for complex cases, and computational demands—suggesting that responsible AI in healthcare requires addressing all three issues, not just improving accuracy alone.