SafetyTrustworthinessSecuritycs.LG
Exploiting the Potential of Datasets: A Data-Centric Approach for Model Robustness
Yiqi Zhong, Lei Wu, Xianming Liu, Junjun Jiang
March 10, 2022
arXiv.org
10 citations
Key Takeaways
-
Dataset quality matters as much as model design: Rather than only focusing on changing how AI models are built or trained, this research shows that carefully constructing better training datasets is a practical and effective way to make AI systems more robust and reliable.
-
Adversarial examples should be part of training data: The researchers improved model robustness by intentionally including adversarial examples (inputs designed to fool AI systems) in their training datasets, helping models learn to resist malicious attacks before deployment.
-
Real-world corruptions deserve attention: The optimized dataset included 14 types of common corruptions (like image blur, noise, or weather effects), suggesting that AI systems need exposure to realistic imperfections during training to perform reliably in actual use.
-
Data-centric approaches are competitive: The algorithm ranked in the top 4 out of over 3,000 competitors in a major competition, demonstrating that investing in dataset quality can be as effective as other technical approaches for building trustworthy AI systems.
-
This approach works across different models: The method improved robustness for "many existing DNN models," indicating that better datasets provide a generalizable solution rather than requiring custom modifications to each individual AI system.