FairnessTransparencyExplainabilityeess.IV
Fair Conformal Predictors for Applications in Medical Imaging
Charles Lu, Andreanne Lemay, Ken Chang, Katharina Hoebel, Jayashree Kalpathy-Cramer
September 9, 2021
AAAI Conference on Artificial Intelligence
115 citations
3 influential
Key Takeaways
-
Conformal predictions can make AI more trustworthy in medical imaging by clearly communicating uncertainty. Rather than forcing AI systems to make definitive diagnoses, conformal predictions allow algorithms to say "I'm confident about this diagnosis" or "I'm uncertain and recommend human review"—providing clinicians with the transparency they need to make informed decisions.
-
Current deep learning models in medical imaging often fail to account for differences across patient populations. The paper demonstrates that standard AI approaches can have unequal performance across different skin tones in dermatology applications, but shows that "equalized coverage" techniques can adjust conformal predictions to provide fair and reliable uncertainty estimates across diverse patient groups.
-
Radiologists see practical value in uncertainty quantification for clinical workflows. Field interviews with radiologists revealed specific use-cases where knowing an AI system's confidence level would improve decision-making, suggesting that uncertainty communication—not just accuracy—is critical for responsible deployment of medical AI.
-
Conformal predictions offer a bridge between "black box" deep learning and clinical practice standards. By providing mathematically rigorous uncertainty estimates that are easier to interpret than traditional deep learning confidence scores, conformal predictions can help close the gap between how AI systems work and what clinicians need to understand to safely use them.