An Efficient FPGA-based Depthwise Separable Convolutional Neural Network Accelerator with Hardware Pruning
ACM Transactions on Reconfigurable Technology and Systems · 31.03.2024 · 17 (1) · 1-20
DOI: 10.1145/3615661 ↗Kurz gefasst
Fachartikel in der Zeitschrift ACM Transactions on Reconfigurable Technology and Systems, online erschienen am 12.02.2024. Verfasst von Zhengyan Liu und 3 weiteren Autor:innen. Die Arbeit wurde bisher 28-mal zitiert (Crossref) und nennt 43 Literaturangaben. Gefördert von: National Natural Science Foundation of China.
Abstract (Originalsprache)
Convolutional neural networks (CNNs) have been widely deployed in computer vision tasks. However, the computation and resource intensive characteristics of CNN bring obstacles to its application on embedded systems. This article proposes an efficient inference accelerator on Field Programmable Gate Array (FPGA) for CNNs with depthwise separable convolutions. To improve the accelerator efficiency, we make four contributions: (1) an efficient convolution engine with multiple strategies for exploiting parallelism and a configurable adder tree are designed to support three types of convolution operations; (2) a dedicated architecture combined with input buffers is designed for the bottleneck network structure to reduce data transmission time; (3) a hardware padding scheme to eliminate invalid padding operations is proposed; and (4) a hardware-assisted pruning method is developed to support online tradeoff between model accuracy and power consumption. Experimental results show that for MobileNetV2 the accelerator achieves 10× and 6× energy efficiency improvement over the CPU and GPU implementation, and 302.3 frames per second and 181.8 GOPS performance that is the best among several existing single-engine accelerators on FPGAs. The proposed hardware-assisted pruning method can effectively reduce 59.7% power consumption at the accuracy loss within 5%.
Förderung
- National Natural Science Foundation of China
Zitieren
APA
Liu, Z., Liu, Q., Yan, S., & Cheung, R. C. C. (2024). An Efficient FPGA-based Depthwise Separable Convolutional Neural Network Accelerator with Hardware Pruning. ACM Transactions on Reconfigurable Technology and Systems, 17(1), 1-20. https://doi.org/10.1145/3615661
Vancouver
Liu Z, Liu Q, Yan S, Cheung RCC. An Efficient FPGA-based Depthwise Separable Convolutional Neural Network Accelerator with Hardware Pruning. ACM Transactions on Reconfigurable Technology and Systems. 2024;17(1):1-20. doi:10.1145/3615661
BibTeX
@article{Liu2024,
author = {Liu, Zhengyan and Liu, Qiang and Yan, Shun and Cheung, Ray C. C.},
title = {An Efficient FPGA-based Depthwise Separable Convolutional Neural Network Accelerator with Hardware Pruning},
journal = {ACM Transactions on Reconfigurable Technology and Systems},
year = {2024},
volume = {17},
number = {1},
pages = {1--20},
doi = {10.1145/3615661}
}
EUVIMED