ExplainabilityTransparencyAccountabilitycs.CV
Prototype-based Interpretable Breast Cancer Prediction Models: Analysis and Challenges
Shreyasi Pathak, Jörg Schlötterer, Jeroen Veltman, Jeroen Geerdink, Maurice van Keulen, Christin Seifert
March 29, 2024
xAI
14 citations
Key Takeaways
-
Prototype quality matters as much as accuracy: The paper reveals that prototype-based models can be "as good as black-box" if the learned prototypes are low quality, meaning that simply achieving high classification performance doesn't guarantee a truly interpretable model—the visual examples the model uses to make decisions must actually be meaningful.
-
Existing evaluations relied on anecdotal evidence: Prior research on breast cancer prediction models evaluated prototype quality through cherry-picked examples rather than systematic measurement, which the authors address by developing PEF-C (Prototype Evaluation Framework for Coherence) to quantitatively assess whether prototypes align with medical domain knowledge.
-
Interpretability by design is feasible for medical imaging: The study demonstrates that self-explainable prototype-based models can match the performance of black-box deep learning models on mammography datasets, suggesting that clinicians don't have to choose between accuracy and understanding how the model reaches its decisions.
-
Systematic evaluation frameworks are needed for responsible AI deployment: The paper highlights a critical gap in how interpretable AI systems are validated—moving beyond anecdotal evidence to rigorous, domain-informed evaluation methods is essential before these models can be trusted in clinical practice.
-
Multiple state-of-the-art models show competitive but imperfect results: Testing three leading prototype-based approaches (ProtoPNet, BRAIxProtoPNet++, and PIP-Net) reveals that while these models are competitive with traditional deep learning, challenges remain in consistently producing high-quality prototypes across different architectures.