BiasFairnessAccountabilitycs.AI
Always Lurking: Understanding and Mitigating Bias in Online Human Trafficking Detection
Kyle Hundman, Thamme Gowda, Mayank Kejriwal, Benedikt Boecking
December 3, 2017
AAAI/ACM Conference on AI, Ethics, and Society
25 citations
4 influential
Key Takeaways
-
AI systems designed to detect human trafficking can inadvertently perpetuate bias: The researchers found that their trafficking detection algorithm exhibited bias patterns that could unfairly flag certain groups or characteristics, demonstrating that even well-intentioned AI applications require rigorous bias analysis before deployment to law enforcement agencies.
-
Bias mitigation is essential before real-world deployment: The paper emphasizes that post hoc bias analyses and mitigation strategies should be integrated into AI systems from the start, particularly when these systems directly influence law enforcement decisions affecting vulnerable populations. The authors developed a specific bias mitigation plan after identifying problems in their initial approach.
-
Interpretability matters for high-stakes decisions: The final system deployed to over 200 law enforcement agencies investigating trafficking incorporated interpretable solutions, allowing officers to understand why an advertisement received a particular risk score rather than relying on a "black box" prediction—critical for maintaining human oversight in sensitive investigations.
-
Scale amplifies the importance of responsible AI practices: With the system analyzing over 100 million advertisements and influencing investigative resource allocation across hundreds of agencies, even small biases in the algorithm could have widespread consequences for how law enforcement prioritizes cases and allocates resources.
-
Multi-institutional collaboration and transparency are necessary for responsible AI deployment: The three-year research process involving multiple institutions and explicit documentation of bias findings suggests that developing trustworthy AI for social good requires sustained, collaborative effort and willingness to publicly acknowledge and address algorithmic limitations.