Automatic Compression of Neural Network with Deep Reinforcement Learning Based on Proximal Gradient Method
Mathematics · 09.01.2023 · 11 (2) · 338
DOI: 10.3390/math11020338 ↗Kurz gefasst
Fachartikel in der Zeitschrift Mathematics, online erschienen am 09.01.2023. Verfasst von Mingyi Wang und 4 weiteren Autor:innen. Die Arbeit wurde bisher 3-mal zitiert (Crossref) und nennt 41 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China, China Postdoctoral Science Foundation, Foreign Expert Project of Ministry of Science and Technology of China.
Abstract (Originalsprache)
In recent years, the model compression technique is very effective for deep neural network compression. However, many existing model compression methods rely heavily on human experience to explore a compression strategy between network structure, speed, and accuracy, which is usually suboptimal and time-consuming. In this paper, we propose a framework for automatically compressing models through the actor–critic structured deep reinforcement learning (DRL) which interacts with each layer in the neural network, where the actor network determines the compression strategy and the critic network ensures the decision accuracy of the actor network through predicted values, thus improving the compression quality of the network. To enhance the prediction performance of the critic network, we impose the L1 norm regularizer on the weights of the critic network to obtain a distinct activation output feature on the representation, thus enhancing the prediction accuracy of the critic network. Moreover, to improve the decision performance of the actor network, we impose the L1 norm regularizer on the weights of the actor network to improve the decision accuracy of the actor network by removing the redundant weights in the actor network. Furthermore, to improve the training efficiency, we use the proximal gradient method to optimize the weights of the actor network and the critic network, which can obtain an effective weight solution and thus improve the compression performance. In the experiment, in MNIST datasets, the proposed method has only a 0.2% loss of accuracy when compressing more than 70% of neurons. Similarly, in CIFAR-10 datasets, the proposed method compresses more than 60% of neurons, with only 7.1% accuracy loss, which is superior to other existing methods. In terms of efficiency, the proposed method also cost the lowest time among the existing methods.
Förderung
- National Natural Science Foundation of China
- China Postdoctoral Science Foundation
- Foreign Expert Project of Ministry of Science and Technology of China
Zitieren
APA
Wang, M., Tang, J., Zhao, H., Li, Z., & Xie, S. (2023). Automatic Compression of Neural Network with Deep Reinforcement Learning Based on Proximal Gradient Method. Mathematics, 11(2), 338. https://doi.org/10.3390/math11020338
Vancouver
Wang M, Tang J, Zhao H, Li Z, Xie S. Automatic Compression of Neural Network with Deep Reinforcement Learning Based on Proximal Gradient Method. Mathematics. 2023;11(2):338. doi:10.3390/math11020338
BibTeX
@article{Wang2023,
author = {Wang, Mingyi and Tang, Jianhao and Zhao, Haoli and Li, Zhenni and Xie, Shengli},
title = {Automatic Compression of Neural Network with Deep Reinforcement Learning Based on Proximal Gradient Method},
journal = {Mathematics},
year = {2023},
volume = {11},
number = {2},
pages = {338},
doi = {10.3390/math11020338}
}
EUVIMED