FairnessBiasAccountabilitycs.LG
Muffin: A Framework Toward Multi-Dimension AI Fairness by Uniting Off-the-Shelf Models
Yi Sheng, Junhuan Yang, Lei Yang, Yiyu Shi, Jingtongf Hu, Weiwen Jiang
August 26, 2023
Design Automation Conference
12 citations
1 influential
Key Takeaways
-
Real-world AI systems face "multi-dimensional fairness" challenges: The paper demonstrates that unfairness in AI doesn't exist in just one dimension—for example, a medical AI model might be biased against both women and people with darker skin tones simultaneously, requiring solutions that address multiple sources of bias at once.
-
Fixing one bias can accidentally create another: The research reveals a critical trade-off problem where optimizing fairness for one attribute (like skin tone) can actually worsen fairness for another attribute. In their dermatology case study, existing approaches achieved 21.05% fairness improvement on one attribute but made a second attribute 1.85% less fair.
-
The Muffin framework improves multiple fairness dimensions simultaneously: Rather than choosing which bias to fix, the proposed approach combines multiple existing AI models to improve fairness across multiple attributes at the same time—achieving 26.32% and 20.37% fairness improvements on two attributes while also gaining 5.58% in overall accuracy.
-
Responsible AI requires thinking beyond single-attribute solutions: Current fairness research typically focuses on one problematic attribute at a time, but this paper shows that real-world applications need frameworks that can balance fairness across multiple dimensions to avoid creating new disparities while fixing old ones.