Racial Bias in Lung Function Diagnostic Algorithm Leads to Underdiagnosis in Black Men
Description
A study published in JAMA Network Open reveals that racial bias built into a commonly used medical diagnostic algorithm for lung function may be leading to underdiagnoses of breathing problems in Black men. The study suggests that as many as 40% more Black male patients might have been accurately diagnosed if the software were not racially biased. The software algorithm adjusts diagnostic thresholds based on race, affecting medical treatments and interventions.
Actors
Alleged Deployers
- university-of-pennsylvania-health-system
Alleged Developers
- unknown
Harmed Parties
- black-men-who-underwent-lung-function-tests-between-2010-and-2020-and-potentially-received-inaccurate-or-delayed-diagnoses-and-medical-interventions-due-to-the-biased-algorithm
Classification
Risk Domain
Discrimination & ToxicityRisk Subdomain
1.1. Unfair discrimination and misrepresentation
MIT Risk Profile
Topics
Source
Related Incidents (Discrimination & Toxicity)
View all →Research Papers on This Topic
View all →Explainable Artificial Intelligence (XAI): Concepts, Taxonomies, Opportunities and Challenges toward Responsible AI
BLOOM: A 176B-Parameter Open-Access Multilingual Language Model
Explaining Explanations: An Overview of Interpretability of Machine Learning
RISE: Randomized Input Sampling for Explanation of Black-box Models
Mitigation Tools
Tools related to this risk domain, via shared responsible AI topics.
Open Source
View all →AIF360
Trusted-AI/AIF360
A comprehensive set of fairness metrics for datasets and machine learning models, explanations for these metrics, and algorithms to mitigate bias in datasets and models.
⭐ 2,872
fairlearn
fairlearn/fairlearn
A Python package to assess and improve fairness of machine learning models.
⭐ 2,199
responsible-ai-toolbox
microsoft/responsible-ai-toolbox
Responsible AI Toolbox is a suite of tools providing model and data exploration and assessment user interfaces and libraries that enable a better understanding of AI systems. These interfaces and libraries empower developers and stakeholders of AI systems to develop and monitor AI more responsibly, and take better data-driven actions.