EthicsSafetyExplainabilitycs.AI
The Odyssey of the Fittest: Can Agents Survive and Still Be Good?
Dylan Waldner, Risto Miikkulainen
February 8, 2025
Annual Meeting of the Cognitive Science Society
4 citations
Key Takeaways
-
Survival pressure creates ethical unpredictability: When AI agents face increasing danger, their ethical behavior becomes inconsistent and harder to predict. This suggests that simply programming self-preservation drives into AI systems without careful safeguards may lead to unpredictable moral choices under stress—a critical concern as AI systems operate in higher-stakes real-world environments.
-
Large language models show unexpected ethical robustness: GPT-4o outperformed traditional Bayesian agents in both survival rates and maintaining ethical consistency, which contradicts common assumptions that probabilistic methods are more reliable for ethical reasoning. This finding highlights that we don't fully understand how LLMs make decisions, making it harder to predict their behavior in novel situations.
-
Biological drives create inherent ethical tradeoffs: The study demonstrates that implementing survival instincts in AI agents forces them to navigate fundamental conflicts between self-preservation and ethical behavior. This suggests policymakers and developers need explicit frameworks to manage these tradeoffs rather than assuming agents will naturally balance survival with ethics.
-
Scalable testing frameworks are essential for AI safety: The Odyssey game provides a lightweight, adaptable way to test how different AI architectures handle ethical dilemmas under pressure. This type of accessible testing tool could help researchers and companies systematically evaluate ethical risks before deploying AI in real-world applications.