FairnessBiasAccountabilitycs.LG
TARA: Training and Representation Alteration for AI Fairness and Domain Generalization
William Paul, Armin Hadzic, Neil Joshi, Fady Alajaji, Phil Burlina
December 11, 2020
Neural Computation
22 citations
Key Takeaways
-
AI bias can be reduced through two complementary strategies: TARA combines representation learning (using adversarial methods to remove bias from how AI "sees" data) with training data augmentation (creating synthetic examples of underrepresented groups), demonstrating that tackling bias requires addressing both how models learn and what data they learn from.
-
Significant fairness improvements are achievable without sacrificing accuracy: On medical imaging (EyePACS), TARA reduced the accuracy gap between demographic groups from 10.5% to 0.5% while actually improving overall accuracy from 71.8% to 78.8%, showing that fairness and performance need not be in conflict.
-
Current fairness metrics may be incomplete: The researchers identified limitations in existing debiasing assessment methods and proposed new "conjunctive metrics" that better evaluate whether AI systems are truly fair across multiple dimensions simultaneously, suggesting the field needs better tools to measure progress.
-
Generative AI can help address data imbalance: By using generative models to create synthetic training examples of underrepresented populations with controlled characteristics, the method addresses a root cause of bias—insufficient or skewed training data—rather than just masking the problem.
-
Results generalize across different domains: Testing on both medical imaging and facial recognition datasets (CelebA) shows the approach works across different types of AI applications, suggesting potential broader applicability to other fairness challenges.