BiasFairnessEthicscs.CL
Language Model Alignment in Multilingual Trolley Problems
Zhijing Jin, Max Kleiman-Weiner, Giorgio Piatti, Sydney Levine, Jiarui Liu, Fernando Gonzalez, Francesco Ortu, András Strausz, Mrinmaya Sachan, Rada Mihalcea, Yejin Choi, Bernhard Schölkopf
July 2, 2024
International Conference on Learning Representations
59 citations
5 influential
Key Takeaways
-
Language models show inconsistent moral reasoning across different languages: The study found "significant variance in alignment across languages," meaning the same AI system may make different ethical decisions depending on which language it's prompted in, challenging the assumption that LLMs apply uniform moral principles regardless of linguistic context.
-
AI moral preferences don't automatically reflect the populations that speak different languages: By comparing LLM decisions across 100+ languages to the Moral Machine dataset's 40 million human judgments from 200+ countries, researchers discovered that AI systems don't reliably align with the actual ethical preferences of speakers in those linguistic regions, raising concerns about whose values are embedded in these systems.
-
Current AI systems exhibit both cross-lingual and ethical biases simultaneously: The research identified biases operating across multiple dimensions—including preferences related to age, gender, social status, and fitness—that vary by language, suggesting that responsible AI development must address how these biases intersect rather than treating them as separate problems.
-
Prompt wording significantly affects AI moral decisions: The study examined "consistency of LLM responses to various prompt paraphrasings," finding that how a moral dilemma is worded influences the AI's choice, indicating that LLM ethics may be unstable and dependent on superficial linguistic factors rather than principled reasoning.
-
Developing fair global AI requires incorporating diverse linguistic and cultural perspectives: The authors emphasize "the importance of incorporating diverse perspectives in AI ethics" and call for "integration of multilingual dimensions in responsible AI research to ensure fair and equitable AI interactions worldwide," suggesting that current AI development may be too narrow in scope.