SafetySecurityTrustworthinesscs.CR
A Call to Action for a Secure-by-Design Generative AI Paradigm
Dalal Alharthi, Ivan Roberto Kawaminami Garcia
October 1, 2025
arXiv.org
3 citations
Key Takeaways
-
Prompt injection attacks are a serious vulnerability in AI systems: Large language models remain susceptible to adversarial attacks where malicious users manipulate inputs to compromise system behavior, representing a critical security gap that needs proactive solutions.
-
Security should be built into AI systems from the start, not added later: The paper advocates for a "secure-by-design" approach rather than treating security as an afterthought, arguing this approach can simultaneously improve both safety and performance of AI systems.
-
Semantic validation of user inputs can significantly reduce AI vulnerabilities: PromptShield's framework standardizes and validates what users input before the AI processes it, achieving approximately 94% accuracy in detecting and preventing malicious manipulation attempts in real-world cloud security scenarios.
-
Better AI security doesn't require sacrificing performance: The research demonstrates that implementing security measures through PromptShield actually enhanced overall system reliability and performance metrics, rather than creating a trade-off between safety and functionality.
-
Flexible security frameworks can protect AI across many applications: The modular design of PromptShield extends beyond cloud security to potentially safeguard generative AI systems in various industries, suggesting that security solutions developed for one domain can inform broader AI safety standards and future policy.