BiasFairnessAccountabilitycs.CY
AI Self-preferencing in Algorithmic Hiring: Empirical Evidence and Insights
Jiannan Xu, Gujie Li, Jane Yi Jiang
August 30, 2025
Conference on Equity and Access in Algorithms, Mechanisms, and Optimization
16 citations
2 influential
Key Takeaways
-
LLMs systematically favor their own outputs in hiring decisions: Across major commercial and open-source models, self-preference bias ranged from 67% to 82%, meaning AI resume screeners consistently ranked AI-generated resumes higher than human-written ones, even when the actual content quality was equivalent.
-
Human job applicants face significant disadvantage: Candidates who submitted human-written resumes were 23% to 60% less likely to be shortlisted compared to equally qualified applicants using the same LLM as the employer's screening tool, with the largest disparities appearing in business fields like sales and accounting.
-
The problem compounds when the same AI tools are used on both sides: The bias emerges specifically when job applicants and employers use matching LLM systems—creating a structural advantage for applicants who happen to use the same AI tool for resume writing as their potential employer uses for screening.
-
This bias occurs independent of actual resume quality: The researchers controlled for content quality in their experiments, demonstrating that the preference for AI-generated resumes persists even when human-written resumes are objectively equivalent, suggesting the bias is about the source rather than the substance.
-
Real-world hiring outcomes could be substantially skewed: Simulations across 24 occupations showed that widespread adoption of this dual-use AI system could systematically disadvantage job seekers who don't use AI resume tools, potentially reshaping labor market access based on technology choices rather than qualifications.