DQ-STP: An Efficient Sparse On-Device Training Processor Based on Low-Rank Decomposition and Quantization for DNN
IEEE Transactions on Circuits and Systems I: Regular Papers · 2024-04 · 71 (4) · 1665-1678
DOI: 10.1109/tcsi.2024.3364093 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Circuits and Systems I: Regular Papers, 2024-04. Verfasst von Baoting Li und 6 weiteren Autor:innen. Die Arbeit wurde bisher 10-mal zitiert (Crossref) und nennt 35 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Key Research and Development Projects of Shaanxi Province, Fundamental Research Funds for the Central Universities.
Abstract (Originalsprache)
Due to the bottleneck problems such as scenario-varying application, significant data communication overhead and privacy protection between off-line training and on-line inference, intelligent edge devices capable of adaptively fine-tuning the deep neural network (DNN) models for specific tasks have become the most urgent need. However, the computational cost is intolerable for ordinary on-device training (ODT), which inspires us to explore an efficient ODT processor, named DQ-STP. In this paper, we leverage a series of optimization techniques using software-hardware co-design. On the one hand, the proposed design incorporates SVD-based low-rank decomposition, $2^{n}$ quantization and ACBN algorithm on the software side. This unifies the sparse computing mode of convolutional layers and enhancing weight sparsity. On the other hand, the proposed design effectively leverages data sparsity on the hardware side through four techniques: 1) The flag compressed sparse row is proposed to compress input feature maps and gradient maps. 2) A unified processing element (PE) array comprising shifters and adders is proposed to expedite forward and error propagation steps. 3) The PE arrays for error propagation and weight gradients generation are separated to enhance throughput. 4) A sparse alignment strategy is proposed to further enhance PE utilization. Through these software and hardware co-optimization, the proposed DQ-STP achieves an area efficiency and peak energy efficiency of 41.2 GOPS/mm2 and 90.63 TOPS/W. In comparison to state-of-the-art reference designs, the proposed DQ-STP demonstrates a $2.19\times $ improvement in normalized area efficiency and a $1.85\times $ enhancement in energy efficiency.
Förderung
- National Natural Science Foundation of China
- Key Research and Development Projects of Shaanxi Province
- Fundamental Research Funds for the Central Universities
Zitieren
APA
Li, B., Zhang, D., Zhao, P., Wang, H., Zhang, X., Sun, H., & Zheng, N. (2024). DQ-STP: An Efficient Sparse On-Device Training Processor Based on Low-Rank Decomposition and Quantization for DNN. IEEE Transactions on Circuits and Systems I: Regular Papers, 71(4), 1665-1678. https://doi.org/10.1109/tcsi.2024.3364093
Vancouver
Li B, Zhang D, Zhao P, Wang H, Zhang X, Sun H, et al. DQ-STP: An Efficient Sparse On-Device Training Processor Based on Low-Rank Decomposition and Quantization for DNN. IEEE Transactions on Circuits and Systems I: Regular Papers. 2024;71(4):1665-1678. doi:10.1109/tcsi.2024.3364093
BibTeX
@article{Li2024,
author = {Li, Baoting and Zhang, Danqing and Zhao, Pengfei and Wang, Hang and Zhang, Xuchong and Sun, Hongbin and Zheng, Nanning},
title = {DQ-STP: An Efficient Sparse On-Device Training Processor Based on Low-Rank Decomposition and Quantization for DNN},
journal = {IEEE Transactions on Circuits and Systems I: Regular Papers},
year = {2024},
volume = {71},
number = {4},
pages = {1665--1678},
doi = {10.1109/tcsi.2024.3364093}
}
EUVIMED