BiasFairnessAccountabilitycs.CV
Exploring Bias in over 100 Text-to-Image Generative Models
Jordan Vice, Naveed Akhtar, Richard Hartley, Ajmal Mian
March 11, 2025
arXiv.org
11 citations
1 influential
Key Takeaways
-
Open-source platforms democratize AI but spread biased models: While platforms like Hugging Face make AI tools widely accessible, they simultaneously distribute models that contain inherent biases, often introduced through task-specific fine-tuning, raising concerns about responsible deployment at scale.
-
Different types of AI models show different bias patterns: The research identifies that artistic and style-transferred models exhibit significant bias, while foundation models (broader, more general-purpose models) are becoming progressively less biased over time, suggesting that model design choices substantially impact fairness outcomes.
-
Bias manifests in multiple measurable ways: The study evaluates bias across three dimensions—distribution bias, generative hallucination, and generative miss-rate—demonstrating that bias in image generation is complex and requires multifaceted evaluation frameworks rather than single metrics.
-
Bias trends are evolving and trackable: By analyzing over 100 models, the research reveals how bias patterns change over time, providing evidence that the AI field can systematically monitor and understand bias evolution, which is essential for developing effective mitigation strategies.
-
Robust evaluation frameworks are critical for ethical AI: The paper emphasizes that ensuring responsible AI deployment requires quantifiable bias metrics and comprehensive evaluation approaches, suggesting that transparency and measurement are foundational to addressing bias in generative AI systems.