ExplainabilityFairnessBiascs.CV
Toward explainable AI approaches for breast imaging: adapting foundation models to diverse populations
Guilherme J. Cavalcante, José Gabriel A. Moreira, Gabriel A. B. do Nascimento, Vincent Dong, Alex Nguyen, Thaís G. do Rêgo, Yuri Malheiros, Telmo M. Silva Filho, Carla R. Zeballos Torrez, James C. Gee, Anne Marie McCarthy, Andrew D. A. Maidment, Bruno Barufaldi
November 21, 2025
Medical Imaging
1 citations
Key Takeaways
-
Foundation models can be adapted for medical imaging across diverse populations: The study successfully adapted BiomedCLIP, a foundation model, for breast density classification and demonstrated strong generalization on external datasets (RSNA and EMBED), with AUC values ranging from 0.80-0.93, suggesting these models can work reliably across different patient populations and imaging settings.
-
Multi-modality training improves AI system flexibility without sacrificing accuracy: The multi-modality model achieved comparable accuracy (0.74) to single-modality approaches (0.73) while maintaining the ability to work across different imaging types (synthesized 2D, digital mammography, and digital breast tomosynthesis), making the AI system more practical for real-world clinical deployment where imaging equipment varies.
-
Explainability tools help verify that AI systems focus on clinically relevant features: GradCAM visualizations confirmed the models consistently highlighted clinically appropriate areas in mammograms, providing transparency into how the AI makes decisions—a critical requirement for responsible deployment in healthcare where clinicians need to understand and trust AI recommendations.
-
Addressing class imbalance through weighted contrastive learning improves fairness: The study used weighted contrastive learning to handle imbalanced data, which helps prevent the AI from performing poorly on underrepresented groups—an important consideration for ensuring the technology works equitably across diverse patient populations.
Abstract
Foundation models hold promise for specialized medical imaging tasks, though their effectiveness in breast imaging remains underexplored. This study leverages BiomedCLIP as a foundation model to address challenges in model generalization. BiomedCLIP was adapted for automated BI-RADS breast density classification using multi-modality mammographic data (synthesized 2D images, digital mammography, and digital breast tomosynthesis). Using 96,995 images, we compared single-modality (s2D only) and multi-modality training approaches, addressing class imbalance through weighted contrastive learning. Both approaches achieved similar accuracy (multi-modality: 0.74, single-modality: 0.73), with the multi-modality model offering broader applicability across different imaging modalities and higher AUC values consistently above 0.84 across BI-RADS categories. External validation on the RSNA and EMBED datasets showed strong generalization capabilities (AUC range: 0.80-0.93). GradCAM visualizations confirmed consistent and clinically relevant attention patterns, highlighting the models interpretability and robustness. This research underscores the potential of foundation models for breast imaging applications, paving the way for future extensions for diagnostic tasks.
5 pages, 3 figures
Paper Info
arXiv ID2511.17828
PublishedNovember 21, 2025
Citations
1
Relevance72%
VenueMedical Imaging
TypeJournalArticle
Categorycs.CV
Responsible AI Topics
ExplainabilityFairnessBias
Links
Citation data from Semantic Scholar