BiasFairnessExplainabilitycs.LG
Detecting and Mitigating Algorithmic Bias in Binary Classification using Causal Modeling
Wendy Hui, Wai Kwong Lau
October 19, 2023
2024 4th International Conference on Computer Communication and Information Systems (CCCIS)
5 citations
Key Takeaways
-
Causal modeling offers a practical tool for detecting bias: The researchers demonstrated that causal modeling can identify statistically significant gender bias in prediction models (at the 0.05 significance level), making it possible to pinpoint where unfairness occurs rather than treating algorithms as unexplainable "black boxes."
-
Bias mitigation doesn't require sacrificing accuracy: The study found that using causal models to reduce gender bias actually improved overall classification accuracy slightly, suggesting that fairness and performance aren't necessarily in conflict—a key concern for organizations implementing bias fixes.
-
The approach is accessible to non-specialists: The authors emphasize that their method can be implemented using existing statistical software tools like "lavaan" in R, meaning organizations don't need specialized expertise or custom-built systems to detect and address algorithmic bias in their decision-making systems.
-
Explainability builds trust in AI systems: By using causal modeling rather than treating algorithms as black boxes, the approach makes it easier to understand why bias exists and how it's being addressed, which the authors argue enhances transparency and promotes stakeholder trust in AI systems.
-
Real-world testing on employment data: The researchers validated their approach using the Adult dataset, which contains employment-related information, demonstrating relevance to high-stakes decisions like hiring where algorithmic bias has significant consequences.