AccountabilitySafetyTrustworthinesscs.CR
Continuous Assurance of Agentic Security Auditors for Software Delivery Decision Gates
Guy Lupo, Nguyen Hung Nguyen, Viet Vo, M. A. P. Chamikara, Guangdong Bai, Nazatul Haque Sultan, Alsharif Abuadbba
September 28, 2026
Key Takeaways
-
AI security auditors in software pipelines are unpredictable: LLM-based tools that automatically approve or block code changes produce inconsistent results over time, meaning a security check that passes today might fail tomorrow with the same code, creating challenges for maintaining reliable security standards.
-
One-time security audits are insufficient: Traditional point-in-time security reviews cannot keep pace with changes in AI model behavior, organizational risk policies, or regulatory requirements, necessitating continuous reassessment rather than static approval decisions.
-
The proposed solution separates policy from evidence: The Trustworthy AI Posture (TAIP) Assurance Engine decouples security policies from the underlying audit evidence and AI model execution, allowing organizations to update security rules without re-running expensive audits or changing which code changes are approved.
-
Real-time policy updates are feasible: Testing demonstrated that security posture can be recomputed in just 1.1 milliseconds when policies change, suggesting organizations can update their security requirements in real-time across multiple decision points without significant delays to software delivery.
-
The approach scales across different AI models and environments: By separating policy from execution, the same assurance framework works consistently whether using different AI models (like GPT-4 or GPT-4o-mini) or different organizational contexts, reducing the need to rebuild security systems when tools or environments change.