EthicsTransparencyTrustworthinesscs.CL
Personality Traits in Large Language Models
Greg Serapio-García, Mustafa Safdari, Clément Crepy, Luning Sun, Stephen Fitz, Peter Romero, Marwa Abdulhai, Aleksandra Faust, Maja Matarić
July 1, 2023
arXiv.org
260 citations
18 influential
Key Takeaways
-
LLMs exhibit measurable personality traits: Researchers developed a psychometrically valid methodology to assess personality in 18 different LLMs and found that personality measurements in LLM outputs are reliable and valid under specific prompting configurations, meaning these systems aren't neutral but express consistent personality characteristics.
-
Larger and fine-tuned models show stronger personality consistency: The study found that evidence of reliable and valid personality traits is stronger in larger models and those that have undergone instruction fine-tuning, suggesting that model size and training approach directly influence the personality characteristics users encounter.
-
LLM personalities can be deliberately shaped: The research demonstrates that personality in LLM outputs can be actively shaped to mimic specific human personality profiles, raising important questions about whether users are interacting with authentic AI responses or engineered personas designed to influence behavior.
-
Personality affects communication effectiveness: Since personality is identified as "a key factor determining the effectiveness of communication," the embedded personalities in LLMs may significantly influence how persuasive or impactful these systems are with users—a consideration for responsible deployment.
-
Ethical implications require attention: The paper explicitly highlights ethical concerns around the measurement and shaping of synthetic personality in LLMs, suggesting that as these conversational agents become more widely used, developers and organizations need clear guidelines for responsible use of personality engineering in AI systems.