SafetySecurityAccountabilitycs.CY
Backchaining Loss of Control Mitigations from Mission-Specific Benchmarks in National Security
Matteo Pistillo, Samantha Faraone, Joshua Herman
May 20, 2026
arXiv.org
1 citations
Key Takeaways
-
Practical methodology for identifying AI safety controls: The paper proposes a concrete, three-step approach where national security deployers can identify which capabilities to restrict by analyzing where AI systems fail on mission-specific benchmarks—allowing organizations to "start building Loss of Control mitigations today" using evidence they can generate themselves, rather than waiting for theoretical frameworks.
-
Focus on affordances and permissions as safety levers: The research identifies "affordances and permissions" (what an AI system is allowed to do and what capabilities it has access to) as promising mechanisms for preventing loss of control in high-stakes national security contexts, suggesting these are more actionable intervention points than other approaches.
-
Backchaining from errors to harm pathways: Rather than starting with abstract threat models, the methodology works backward from specific incorrect answers an AI system gives on benchmarks to identify which capabilities would need to be restricted to prevent those errors from leading to downstream harm—making the connection between AI mistakes and real-world risks more concrete and evidence-based.
-
Balancing security with functionality: A key challenge addressed is that restricting AI capabilities to prevent harm must be done "selectively" to preserve the system's ability to perform its intended correct actions, suggesting the goal is targeted restrictions rather than broad capability limitations.
-
Applicable to current deployment contexts: The approach is framed as complementary to other safety methods (threat modeling, continuous monitoring, safety cases) and designed specifically for "high-stakes deployment contexts, such as national security," indicating it's meant for immediate real-world use rather than future scenarios.