ExplainabilityTransparencyAccountabilitycs.LG
Towards Clinical Prediction with Transparency: An Explainable AI Approach to Survival Modelling in Residential Aged Care
Teo Susnjak, Elise Griffin
December 1, 2023
medRxiv
19 citations
1 influential
Key Takeaways
-
Explainability matters for life-and-death decisions: The researchers specifically chose machine learning models that could explain their predictions (using SHAP values) rather than just maximizing accuracy. This transparency is crucial for clinicians making end-of-life decisions, as doctors need to understand why a model predicts a particular survival outcome, not just trust a "black box" number.
-
The model identifies clinically meaningful risk factors: The study found that age, male gender, mobility limitations, overall health status, pressure ulcer risk, and appetite are the strongest predictors of 6-month survival in aged care residents. These align with what clinicians already know, which builds confidence that the AI system is capturing real medical patterns rather than spurious correlations.
-
Moderate accuracy requires cautious implementation: With a 6-month survival prediction accuracy (AUROC) of 0.746, the model performs better than chance but is far from perfect. This suggests the tool should support clinical judgment rather than replace it—doctors should use these predictions as one input among many, not as definitive forecasts.
-
Large, real-world dataset strengthens applicability: The model was trained on nearly 12,000 residents across 40 facilities over six years, making it more likely to work reliably in practice compared to studies using smaller or more homogeneous populations. This real-world grounding is essential for responsible AI deployment in healthcare.
-
Calibration ensures trustworthy predictions: The researchers specifically calibrated the model so that when it predicts a 70% survival probability, patients actually survive at approximately that rate. This prevents overconfident or misleading predictions that could lead to inappropriate medical decisions.