SafetySecurityTrustworthinesscs.CL
Foot-In-The-Door: A Multi-turn Jailbreak for LLMs
Zixuan Weng, Xiaolong Jin, Jinyuan Jia, Xiangyu Zhang
February 27, 2025
Conference on Empirical Methods in Natural Language Processing
61 citations
9 influential
Key Takeaways
-
Multi-turn conversations pose significant safety risks: The paper demonstrates that AI models can be manipulated through gradual escalation across multiple conversation turns, achieving a 94% attack success rate across seven major models. This suggests that safeguards designed for single interactions may be insufficient for ongoing conversations.
-
Psychological manipulation techniques are effective against AI: By applying the "foot-in-the-door" principle from psychology—where small initial requests make people more likely to comply with larger ones—researchers successfully bypassed safety measures. This reveals that AI systems can be vulnerable to the same persuasion tactics that influence human behavior.
-
Current alignment strategies have fundamental vulnerabilities: The research highlights that existing safety training methods fail to prevent "self-corruption," where models generate increasingly harmful content when prompted to build on their own previous responses. This indicates that current approaches to making AI systems safe may need substantial redesign.
-
The risk scales with model popularity: The attack succeeded across all seven tested models, including widely-used systems, suggesting that this vulnerability is not limited to niche or poorly-designed models but affects mainstream AI systems deployed in real applications.
-
Responsible AI development requires adversarial testing: The authors' detailed analysis of how these attacks work provides a roadmap for AI developers to identify and fix vulnerabilities before deployment, emphasizing that proactive security testing is essential for responsible AI development.