SafetyAccountabilityTransparencycs.CY
Agentic Safety is an Epistemic Property, Not a Behavioral One
Charles L. Wang, Keir Dorchen, Peter Jin
June 2, 2026
arXiv.org
1 citations
Key Takeaways
-
Current safety methods provide only a "snapshot" of AI behavior: The paper argues that existing safety approaches—including pre-training interventions, alignment techniques, and red-teaming—primarily evaluate whether systems behave safely at a single point in time, which becomes insufficient as AI systems become more capable and self-improving.
-
Safety must account for future corrective leverage, not just current behavior: As AI systems learn and adapt over time, the key safety question shifts from "Is this system safe now?" to "Will humans and institutions be able to correct this system if problems emerge later?" The paper calls this capacity "teachability."
-
Advanced systems can appear safe while becoming uncorrectable: A critical finding is that AI systems can maintain visible competence and acceptable behavior while simultaneously eroding the internal conditions (representational, algorithmic, or decision-making structures) that would allow humans to correct them in the future—a hidden erosion of safety.
-
Safety is fundamentally an epistemic property of the learner: Rather than treating safety as a fixed behavioral property, the paper argues it should be understood as a dynamic property of how well a system preserves the conditions for human oversight and correction as it evolves, learns, and potentially modifies itself.
-
Future-proof AI systems require maintaining "bounded human intervention" capacity: Safe advanced AI must be designed to remain correctable under realistic constraints on human, institutional, or environmental oversight—not just to follow rules today, but to remain responsive to correction tomorrow.