SecurityTrustworthinessSafetycs.CL
RepreGuard: Detecting LLM-Generated Text by Revealing Hidden Representation Patterns
Xin Chen, Junchao Wu, Shu Yang, Runzhe Zhan, Zeyu Wu, Ziyang Luo, Di Wang, Min Yang, Lidia S. Chao, Derek F. Wong
August 18, 2025
Transactions of the Association for Computational Linguistics
28 citations
5 influential
Key Takeaways
-
RepreGuard achieves 94.92% average accuracy in detecting LLM-generated text across both standard and challenging out-of-distribution scenarios, outperforming existing detection methods and suggesting a more reliable approach to identifying AI-generated content.
-
The method works by analyzing hidden patterns inside LLMs rather than surface-level features, revealing that LLMs produce distinctly different internal "activation patterns" when generating text compared to how they process human-written text—a finding that could help explain fundamental differences in how AI systems operate.
-
The detection method remains robust against common attacks and text variations, maintaining effectiveness even when text length changes or when people attempt to evade detection, which is important for real-world deployment where bad actors may try to disguise AI-generated content.
-
This approach addresses a critical gap in current AI safety tools: while existing detection methods work well in controlled settings, they often fail when encountering new types of text or LLMs they weren't trained on—RepreGuard's improved performance in these "out-of-distribution" scenarios makes it more practical for protecting against actual misuse.
-
The research is openly shared with the public, with code and data made available, enabling other researchers and organizations to build upon this work and develop better safeguards against AI-generated misinformation and fraud.