FairnessBiasAccountabilitycs.LG
Individual Fairness under Uncertainty
Wenbin Zhang, Zichong Wang, Juyong Kim, Cheng Cheng, Thomas Oommen, Pradeep Ravikumar, Jeremy Weiss
February 16, 2023
European Conference on Artificial Intelligence
18 citations
Key Takeaways
-
Fairness research often assumes perfect information, but real-world systems don't have it: The paper addresses a gap in algorithmic fairness research by tackling situations where class labels are incomplete or uncertain—a common scenario in practice that most fairness studies ignore by assuming labels are always known upfront.
-
The proposed approach treats similar people similarly without requiring complex mathematical constraints: Unlike existing individual fairness methods that rely on strict mathematical conditions (Lipschitz constraints), this work offers a more practical ranking-based approach that's easier to implement while still ensuring people in similar circumstances receive similar treatment.
-
The method successfully reduces discrimination while maintaining accuracy: Experiments on four real-world datasets showed the approach could minimize discriminatory outcomes without sacrificing the predictive performance of the ML system—addressing a key concern that fairness improvements often come at a cost to accuracy.
-
This work reflects a shift toward "fairness in the wild": By acknowledging uncertainty in data labels, the paper represents a more realistic model of how algorithmic fairness should be studied and deployed, moving beyond idealized laboratory conditions to address challenges that practitioners actually encounter in high-stakes applications.