FairnessBiasAccountabilitycs.SE
Fairway: A Way to Build Fair ML Software
Joymallya Chakraborty, Suvodeep Majumder, Zhe Yu, Tim Menzies
March 23, 2020
arXiv.org
2 citations
Key Takeaways
-
Bias in training data directly harms model fairness: The paper demonstrates that "ground-truth bias" present in the data used to train AI systems translates into biased decisions by the resulting models, meaning discrimination can be baked into AI systems from the start if training data isn't carefully examined.
-
Bias can be detected and reduced without sacrificing accuracy: Fairway's approach successfully identifies and mitigates algorithmic discrimination while maintaining the model's predictive performance, suggesting that fairness and accuracy are not necessarily in conflict—organizations don't have to choose between one or the other.
-
Bias testing should be standard practice: The authors argue that testing for bias and removing it "should be a routine part of the machine learning software development life cycle," similar to how software engineers routinely test for bugs, indicating that fairness checks need to become as normalized as other quality assurance processes.
-
Multiple intervention points exist to address bias: By combining "pre-processing" (cleaning biased training data before model training) and "in-processing" (adjusting the model itself during or after training) approaches, the paper shows there are multiple opportunities to intervene and reduce discrimination, giving organizations flexibility in how they address fairness issues.