ExplainabilityTransparencyTrustworthinesscs.CV
Stable Vision Concept Transformers for Medical Diagnosis
Lijie Hu, Songning Lai, Yuan Hua, Shu Yang, Jingfeng Zhang, Di Wang
June 5, 2025
ECML/PKDD
3 citations
Key Takeaways
-
Explainability doesn't require sacrificing accuracy: The paper demonstrates that Stable Vision Concept Transformers (SVCT) can maintain diagnostic accuracy while providing human-understandable explanations, addressing a key concern that transparency often comes at the cost of model performance in medical AI systems.
-
Concept-based explanations need stability to be trustworthy: The research identifies a critical problem with existing explainable AI methods—they provide unstable explanations when medical images are slightly altered or perturbed. SVCT addresses this by using "Denoised Diffusion Smoothing" to ensure explanations remain consistent, which is essential for clinical reliability.
-
Combining multiple types of information improves both performance and interpretability: Rather than relying solely on human-understandable concepts, SVCT fuses conceptual features with raw image features, suggesting that the most effective medical AI systems may need to balance interpretability with the nuanced pattern recognition that deep learning provides.
-
Validation across multiple datasets strengthens real-world applicability: The paper tests SVCT on four different medical datasets, demonstrating that the approach generalizes beyond single-domain performance—an important consideration for deploying explainable AI tools across diverse clinical settings and patient populations.