FairnessAccountabilityEthicscs.AI
Diversity and Inclusion Metrics in Subset Selection
Margaret Mitchell, Dylan Baker, Nyalleng Moorosi, Emily Denton, Ben Hutchinson, Alex Hanna, Timnit Gebru, Jamie Morgenstern
February 9, 2020
AAAI/ACM Conference on AI, Ethics, and Society
96 citations
7 influential
Key Takeaways
-
Diversity and inclusion require distinct metrics in AI systems: The paper distinguishes between diversity (representing different perspectives/groups) and inclusion (ensuring meaningful access and participation), showing these are separate concepts that both matter for fair subset selection—they shouldn't be treated as interchangeable.
-
Human preferences validate the proposed fairness approach: Results from human subject experiments support the paper's diversity and inclusion metrics, suggesting that people intuitively recognize and value these criteria when evaluating AI-selected subsets, lending real-world credibility to the technical framework.
-
Multiple fairness constraints can work together: The research demonstrates that diversity and inclusion metrics can be applied "together, separately, and in tandem with additional fairness constraints," offering flexibility for organizations to combine different fairness objectives based on their specific context and values.
-
Social choice methods can help resolve fairness trade-offs: The paper proposes using social choice theory (methods for aggregating preferences) to select preferred sets when fairness goals conflict, providing a structured approach to navigate the inherent tensions between different ethical objectives in AI systems.
-
Subset selection decisions have real equity implications: By focusing on subset selection problems (hiring, admissions, resource allocation), the paper highlights how AI systems that choose who gets included in groups must actively account for "social power and access differentials" or risk perpetuating existing inequalities.