ExplainabilityTransparencySafetycs.CV
DeepGI: Explainable Deep Learning for Gastrointestinal Image Classification
Walid Houmaidi, Mohamed Hadadi, Youssef Sabiri, Yousra Chtouki
November 26, 2025
arXiv.org
2 citations
1 influential
Key Takeaways
-
High accuracy alone isn't enough for clinical use: While the models achieved 96.5% accuracy, the paper emphasizes that explainability through Grad-CAM visualization is equally important, allowing doctors to see which parts of the image influenced each diagnosis rather than treating the AI as a "black box."
-
Real-world messy data matters: The study specifically addressed practical challenges like variable lighting, changing camera angles, and imaging artifacts—demonstrating that responsible AI development requires testing on realistic conditions rather than idealized datasets, making the results more trustworthy for actual hospital use.
-
Dataset diversity is foundational: The research used 4,000 endoscopic images across four disease classes, highlighting that building reliable medical AI requires diverse, clinically relevant datasets; this is a prerequisite for responsible deployment rather than an afterthought.
-
Model choice affects interpretability: Different architectures (VGG16, MobileNetV2, Xception) performed similarly well (94-96.5% accuracy), but the paper's inclusion of visual explanations for all models suggests that responsible AI development should prioritize which models can be meaningfully explained to clinicians, not just which perform best numerically.
-
Explainability enables clinical oversight: By showing doctors which image regions drove each prediction, Grad-CAM visualization preserves human judgment in the diagnostic loop—allowing clinicians to catch potential errors or unusual cases rather than blindly trusting algorithmic outputs.