FairnessExplainabilityAccountabilitycs.HC
Evidence-based explanation to promote fairness in AI systems
Juliana Jansen Ferreira, Mateus de Souza Monteiro
March 3, 2020
arXiv.org
6 citations
Key Takeaways
-
Explainability is essential for fairness accountability: When AI systems influence important decisions—from judicial outcomes to financial approvals—people need to understand how AI contributed to those decisions. Without clear explanations, it becomes impossible to assess whether decisions were fair or to hold decision-makers responsible.
-
High-stakes decisions require special attention: The paper emphasizes that AI explanations are "particularly critical in contexts where human expertise is central to decision-making," such as legal or medical scenarios. In these domains, the stakes are too high to rely on unexplainable AI recommendations.
-
"Evidence-based explanation" can help tell the decision story: Rather than just showing AI outputs, the authors propose an explanation design approach that presents evidence supporting how a decision was reached. This narrative approach helps people understand the full context and reasoning behind AI-assisted decisions.
-
Current AI systems may obscure fairness issues: The paper highlights that without proper explanations, bias and unfairness in AI systems can go undetected. When people don't understand AI's role in a decision, they cannot identify or correct discriminatory outcomes.
-
Explainability supports human responsibility: By making AI's contribution transparent, explanation design helps ensure that humans—not algorithms—remain accountable for final decisions. This is crucial for maintaining ethical decision-making in sensitive contexts.