TransparencySafetyExplainabilitycs.LG
Latent Structure of Affective Representations in Large Language Models
Benjamin J. Choi, Melanie Weber
April 8, 2026
arXiv.org
4 citations
Key Takeaways
-
LLMs develop emotionally coherent representations: The research demonstrates that large language models learn organized internal representations of emotions that align with the valence-arousal model—a well-established psychological framework where emotions are mapped along dimensions of pleasantness and intensity. This suggests LLMs capture meaningful emotional concepts rather than processing them arbitrarily.
-
Linear approximations work well for understanding AI "black boxes": While the geometric structure of LLM representations is actually nonlinear and complex, the study finds these structures can be effectively approximated using linear methods. This supports a key assumption used in AI transparency research, validating simpler approaches to interpreting how models work internally.
-
Emotion processing reveals model uncertainty: By examining how LLMs represent emotions, researchers can quantify when models are uncertain about their outputs. This capability could help identify situations where AI systems may be unreliable, contributing to safer deployment of these systems in real-world applications.
-
Emotions provide a testable window into AI safety: Because emotions have well-documented psychological properties, they serve as a useful benchmark for validating theories about how LLMs organize information. This approach addresses a major challenge in AI safety research: the difficulty of verifying claims about internal model behavior when ground truth is unknown.