BIRDNN: Behavior-Imitation Based Repair for Deep Neural Networks
Neural Networks · 2025-03 · 183 · 106949
DOI: 10.1016/j.neunet.2024.106949 ↗Kurz gefasst
Fachartikel in der Zeitschrift Neural Networks, 2025-03. Verfasst von Zhen Liang und 7 weiteren Autor:innen. Beteiligte Einrichtung: College of Computer Science and Technology, National University of Defense Technology, Changsha, 410000, Hunan, China. Hauptthemen laut MEDLINE: Neural Networks, Computer, Deep Learning, Behavior. Die Arbeit wurde bisher 5-mal zitiert (Crossref) und nennt 80 Literaturangaben. Gefördert von: Institute of Software Chinese Academy of Sciences, Key Technologies Research and Development Program, Chinese Academy of Sciences.
Abstract (Originalsprache)
The increasing utilization of deep neural networks (DNNs) in safety-critical systems has raised concerns about their potential to exhibit undesirable behaviors. Consequently, DNN repair/patching arises in response to the times, and it aims to eliminate unexpected predictions generated by flawed DNNs. However, existing repair methods, both retraining- and fine-tuning-based, primarily focus on high-level abstract interpretations or inferences of state spaces, often neglecting the outputs of underlying neurons. As a result, present patching strategies become computationally prohibitive and own restricted application scope (often limited to DNNs with piecewise linear (PWL) activation functions), particularly for domain-wise repair problems (DRPs). To overcome these limitations, we introduce BIRDNN, a behavior-imitation based DNN repair framework that supports alternative retraining and fine-tuning repair paradigms for DRPs. BIRDNN employs a sampling technique to characterize DNN domain behaviors and rectifies incorrect predictions by imitating the expected behaviors of positive samples during the retraining-based repair process. As for the fine-tuning repair strategy, BIRDNN analyzes the behavior differences of neurons between positive and negative samples to pinpoint the most responsible neurons for erroneous behaviors, and then integrates particle swarm optimization algorithm (PSO) to fine-tune buggy DNNs locally. Furthermore, we have developed a prototype tool for BIRDNN and evaluated its performance on two widely used DRP benchmarks, the ACAS Xu DNN safety repair problem and the MNIST DNN robustness repair problem. The experiments demonstrate that BIRDNN features more excellent effectiveness, efficiency, and compatibility in repairing buggy DNNs comprehensively compared with state-of-the-art repair methods.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- College of Computer Science and Technology, National University of Defense Technology, Changsha, 410000, Hunan, China.
- Key Laboratory of System Software (Chinese Academy of Sciences) and State Key Laboratory of Computer Science, Institute of Software, Chinese Academy of Sciences, Beijing, 100190, China; School of Computer Science and Te…
- School of Computer Science and Engineering, Nanyang Technological University, 639798, Singapore.
- College of Computer Science and Technology, National University of Defense Technology, Changsha, 410000, Hunan, China; Key Laboratory of Software Engineering for Complex Systems, National University of Defense Technolog…
- Key Laboratory of System Software (Chinese Academy of Sciences) and State Key Laboratory of Computer Science, Institute of Software, Chinese Academy of Sciences, Beijing, 100190, China.
Förderung
- Institute of Software Chinese Academy of Sciences
- Key Technologies Research and Development Program
- Chinese Academy of Sciences
- National Key Research and Development Program of China
- National Natural Science Foundation of China
Zitieren
APA
Liang, Z., Wu, T., Zhao, C., Liu, W., Xue, B., Yang, W., Wang, J., & Huang, W. (2025). BIRDNN: Behavior-Imitation Based Repair for Deep Neural Networks. Neural Networks, 183, 106949. https://doi.org/10.1016/j.neunet.2024.106949
Vancouver
Liang Z, Wu T, Zhao C, Liu W, Xue B, Yang W, et al. BIRDNN: Behavior-Imitation Based Repair for Deep Neural Networks. Neural Networks. 2025;183:106949. doi:10.1016/j.neunet.2024.106949
BibTeX
@article{Liang2025,
author = {Liang, Zhen and Wu, Taoran and Zhao, Changyuan and Liu, Wanwei and Xue, Bai and Yang, Wenjing and Wang, Ji and Huang, Wanrong},
title = {BIRDNN: Behavior-Imitation Based Repair for Deep Neural Networks},
journal = {Neural Networks},
year = {2025},
volume = {183},
pages = {106949},
doi = {10.1016/j.neunet.2024.106949}
}
EUVIMED