FairnessBiasAccountabilitycs.LG
Evaluating the Impact of Social Determinants on Health Prediction in the Intensive Care Unit
Ming Ying Yang, Gloria Hyunjung Kwak, Tom Pollard, Leo Anthony Celi, Marzyeh Ghassemi
May 22, 2023
AAAI/ACM Conference on AI, Ethics, and Society
30 citations
Key Takeaways
-
SDOH data doesn't automatically improve predictions for general populations: The study found that adding community-level social determinants of health features to standard hospital prediction models did not enhance overall performance, suggesting that simply including more data types isn't a guaranteed path to better AI systems.
-
SDOH features matter most for fairness in under-resourced settings: While SDOH didn't boost general performance, the researchers discovered these features "can improve data-limited model fairness for specific subpopulations," indicating that social context becomes particularly important when training data is scarce for certain patient groups.
-
Current hospital AI systems miss critical bias sources: The paper demonstrates that "SDOH features are vital for conducting thorough audits of algorithmic biases beyond protective attributes," meaning that audits focusing only on race, gender, and age miss important ways that AI systems may be unfair—such as through neighborhood-level factors that correlate with health outcomes.
-
Healthcare AI needs better data integration: Most existing hospital prediction models lack comprehensive social determinant information because these features "are often noisy or simply unavailable," highlighting a practical barrier to building more equitable AI systems in healthcare settings.
-
New benchmarks are needed to study AI fairness holistically: The researchers created an integrated EHR-SDOH database to enable future research, arguing that studying algorithmic bias requires moving "beyond race, gender, and age" to include the broader social and economic conditions affecting patient populations.