FairnessBiasAccountabilitystat.ML
A statistical framework for fair predictive algorithms
Kristian Lum, James Johndrow
October 25, 2016
arXiv.org
116 citations
3 influential
Key Takeaways
-
Removing bias requires more than just omitting protected variables: The paper demonstrates that simply excluding race from a predictive model—the most common industry practice—still produces racially disparate predictions. This finding challenges a widespread assumption that ignoring sensitive information automatically creates fairness.
-
Training data inherits historical bias: The research confirms that algorithms trained on historical data don't achieve neutrality simply by being computational. Since the data itself was generated by biased human processes, algorithms can actually amplify existing prejudices rather than eliminate them, particularly in high-stakes domains like criminal justice.
-
A statistical framework for fairness is possible: The authors propose a probabilistic method to remove bias by systematically eliminating information about protected variables from training data. This approach is flexible enough to work with different data types (binary, continuous, etc.), offering a more rigorous alternative to current practices.
-
Criminal justice algorithms show real-world disparities: When applied to sentencing and parole data, the paper's analysis reveals that current "race-neutral" prediction models produce different outcomes across racial groups—demonstrating that algorithmic bias isn't theoretical but actively affecting consequential decisions about people's freedom.
-
Fairness in AI requires intentional technical intervention: The paper establishes that achieving fair algorithms demands deliberate statistical methods, not passive neutrality. Organizations using predictive models in high-stakes settings need to actively implement bias-removal techniques rather than assuming computers are inherently objective.