SafetyTrustworthinessSecuritycs.CV
Deep Verifier Networks: Verification of Deep Discriminative Models with Deep Generative Models
Tong Che, Xiaofeng Liu, Site Li, Yubin Ge, Ruixiang Zhang, Caiming Xiong, Yoshua Bengio
November 18, 2019
AAAI Conference on Artificial Intelligence
54 citations
6 influential
Key Takeaways
-
Independent verification improves safety without retraining: The framework allows a single verifier network to check predictions from different deep learning models without needing to be retrained for each new model, making it practical for real-world deployment in safety-critical applications like autonomous driving.
-
Detects when AI systems encounter unfamiliar situations: The verifier successfully identifies out-of-distribution inputs—cases where the AI encounters data significantly different from its training data—which is crucial for preventing confident but unreliable predictions in autonomous systems.
-
Catches adversarial attacks and unusual outputs: The approach achieved state-of-the-art results in detecting both adversarial examples (deliberately crafted inputs designed to fool AI) and anomalies in complex tasks like image captioning, addressing two major failure modes in deep learning systems.
-
Works across different types of AI tasks: Beyond image classification, the method successfully verified predictions in structured prediction tasks like image caption generation, suggesting the approach generalizes across diverse AI applications rather than being limited to one domain.
-
Provides theoretical grounding for practical verification: The use of conditional variational autoencoders with disentanglement constraints offers both intuitive explanations and theoretical justification for why the verification approach works, supporting confidence in the method's reliability.