An Empirical Study on the Effect of Training Data Perturbations on Neural Network Robustness
Sensors · 26.07.2024 · 24 (15) · 4874
DOI: 10.3390/s24154874 ↗Kurz gefasst
Fachartikel in der Zeitschrift Sensors, online erschienen am 26.07.2024. Verfasst von Jie Wang und 3 weiteren Autor:innen. Beteiligte Einrichtung: The Key Laboratory on Reliability and Environment Engineering Technology, School of Reliability and Systems Engineering, Beihang University, Beijing …. Die Arbeit wurde bisher 9-mal zitiert (Crossref) und nennt 46 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Key Lab of Reliability and Environmental Engineering Technology.
Abstract (Originalsprache)
The vulnerability of modern neural networks to random noise and deliberate attacks has raised concerns about their robustness, particularly as they are increasingly utilized in safety- and security-critical applications. Although recent research efforts were made to enhance robustness through retraining with adversarial examples or employing data augmentation techniques, a comprehensive investigation into the effects of training data perturbations on model robustness remains lacking. This paper presents the first extensive empirical study investigating the influence of data perturbations during model retraining. The experimental analysis focuses on both random and adversarial robustness, following established practices in the field of robustness analysis. Various types of perturbations in different aspects of the dataset are explored, including input, label, and sampling distribution. Single-factor and multi-factor experiments are conducted to assess individual perturbations and their combinations. The findings provide insights into constructing high-quality training datasets for optimizing robustness and recommend the appropriate degree of training set perturbations that balance robustness and correctness, and contribute to understanding model robustness in deep learning and offer practical guidance for enhancing model performance through perturbed retraining, promoting the development of more reliable and trustworthy deep learning systems for safety-critical applications.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- The Key Laboratory on Reliability and Environment Engineering Technology, School of Reliability and Systems Engineering, Beihang University, Beijing 100191, China.
- CRRC Zhuzhou Institute Co., Ltd., Zhuzhou 412001, China.
Förderung
- Key Lab of Reliability and Environmental Engineering Technology
Zitieren
APA
Wang, J., Wu, Z., Lu, M., & Ai, J. (2024). An Empirical Study on the Effect of Training Data Perturbations on Neural Network Robustness. Sensors, 24(15), 4874. https://doi.org/10.3390/s24154874
Vancouver
Wang J, Wu Z, Lu M, Ai J. An Empirical Study on the Effect of Training Data Perturbations on Neural Network Robustness. Sensors. 2024;24(15):4874. doi:10.3390/s24154874
BibTeX
@article{Wang2024,
author = {Wang, Jie and Wu, Zili and Lu, Minyan and Ai, Jun},
title = {An Empirical Study on the Effect of Training Data Perturbations on Neural Network Robustness},
journal = {Sensors},
year = {2024},
volume = {24},
number = {15},
pages = {4874},
doi = {10.3390/s24154874}
}
EUVIMED