FairnessBiascs.LG
Responsible AI Challenges in End-to-end Machine Learning
Steven Euijong Whang, Ki Hyun Tae, Yuji Roh, Geon Heo
January 15, 2021
IEEE Data Engineering Bulletin
10 citations
Key Takeaways
-
Responsible AI must address multiple objectives simultaneously: The paper emphasizes that fairness, robustness, and explainability cannot be pursued in isolation. The authors propose FR-Train, a framework that handles fairness and robustness together during model training, recognizing that these goals can interact with and affect one another.
-
Responsible AI challenges extend beyond model training to the entire machine learning pipeline: Rather than focusing only on the algorithm itself, responsible AI requires attention to all stages including data collection, data cleaning, model evaluation, and deployment. The paper highlights data pre-processing as particularly critical, introducing tools like Slice Tuner and MLClean that improve fairness and robustness at these earlier stages.
-
Data quality and bias at the source are foundational problems: The paper identifies data bias and data poisoning as key challenges that propagate through the entire machine learning system. By addressing these issues during data collection and cleaning phases, organizations can prevent discriminatory outcomes before models are even trained.
-
Responsible AI implementation must be user-friendly to achieve widespread adoption: The authors stress that supporting responsible AI objectives "must be as easy as possible" for practitioners. This suggests that technical frameworks alone are insufficient—responsible AI tools need to be accessible and practical for real-world deployment by companies of all sizes.