BiasFairnessAccountabilitycs.CY
Demographic Inference and Representative Population Estimates from Multilingual Social Media Data
Zijian Wang, Scott A. Hale, David Adelani, Przemyslaw A. Grabowicz, Timo Hartmann, Fabian Flöck, David Jurgens
May 15, 2019
The Web Conference
236 citations
31 influential
Key Takeaways
-
Multilingual demographic inference can reduce algorithmic bias: The paper's new system works across 32 languages and "substantially outperforms current state of the art while also reducing algorithmic bias," addressing a critical gap where existing tools have historically favored dominant languages and groups.
-
Social media data is significantly skewed and requires correction: The research demonstrates that social media users are not representative of broader populations, and the paper proposes "fully interpretable multilevel regression methods" to correct for these sampling biases—an important step for anyone using social media data to make claims about real-world populations.
-
Combining multiple approaches yields more accurate population estimates: By pairing demographic inference with post-stratification techniques, the authors show that "demographic inference and bias correction together allow for more accurate estimates of populations," suggesting that single-method approaches to understanding populations from social media are insufficient.
-
Transparency and interpretability matter for demographic tools: The paper emphasizes "fully interpretable" methods rather than black-box approaches, which is crucial for responsible AI since demographic inference tools can perpetuate or amplify existing societal biases if their decision-making processes aren't understandable.
-
Global representation requires multilingual and multimodal approaches: The research demonstrates that understanding diverse global populations through social media demands systems that work across languages and combine multiple data types, not just text-based analysis in English or other dominant languages.