Hardware-Aware DNN Compression via Diverse Pruning and Mixed-Precision Quantization
IEEE Transactions on Emerging Topics in Computing · 2024-10 · 12 (4) · 1079-1092
DOI: 10.1109/tetc.2023.3346944 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Emerging Topics in Computing, 2024-10. Verfasst von Konstantinos Balaskas und 6 weiteren Autor:innen. Die Arbeit wurde bisher 41-mal zitiert (Crossref) und nennt 45 Literaturangaben. Gefördert von: NSF, Deutsche Forschungsgemeinschaft, E.C. Funded Program.
Abstract (Originalsprache)
Deep Neural Networks (DNNs) have shown significant advantages in a wide variety of domains. However, DNNs are becoming computationally intensive and energy hungry at an exponential pace, while at the same time, there is a vast demand for running sophisticated DNN-based services on resource constrained embedded devices. In this paper, we target energy-efficient inference on embedded DNN accelerators. To that end, we propose an automated framework to compress DNNs in a hardware-aware manner by jointly employing pruning and quantization. We explore, for the first time, per-layer fine- and coarse-grained pruning, in the same DNN architecture, in addition to low bit-width mixed-precision quantization for weights and activations. Reinforcement Learning (RL) is used to explore the associated design space and identify the pruning-quantization configuration so that the energy consumption is minimized whilst the prediction accuracy loss is retained at acceptable levels. Using our novel composite RL agent we are able to extract energy-efficient solutions without requiring retraining and/or fine tuning. Our extensive experimental evaluation over widely used DNNs and the CIFAR-10/100 and ImageNet datasets demonstrates that our framework achieves 39% average energy reduction for 1.7% average accuracy loss and outperforms significantly the state-of-the-art approaches.
Förderung
- NSF
- Deutsche Forschungsgemeinschaft
- E.C. Funded Program
Zitieren
APA
Balaskas, K., Karatzas, A., Sad, C., Siozios, K., Anagnostopoulos, I., Zervakis, G., & Henkel, J. (2024). Hardware-Aware DNN Compression via Diverse Pruning and Mixed-Precision Quantization. IEEE Transactions on Emerging Topics in Computing, 12(4), 1079-1092. https://doi.org/10.1109/tetc.2023.3346944
Vancouver
Balaskas K, Karatzas A, Sad C, Siozios K, Anagnostopoulos I, Zervakis G, et al. Hardware-Aware DNN Compression via Diverse Pruning and Mixed-Precision Quantization. IEEE Transactions on Emerging Topics in Computing. 2024;12(4):1079-1092. doi:10.1109/tetc.2023.3346944
BibTeX
@article{Balaskas2024,
author = {Balaskas, Konstantinos and Karatzas, Andreas and Sad, Christos and Siozios, Kostas and Anagnostopoulos, Iraklis and Zervakis, Georgios and Henkel, Jörg},
title = {Hardware-Aware DNN Compression via Diverse Pruning and Mixed-Precision Quantization},
journal = {IEEE Transactions on Emerging Topics in Computing},
year = {2024},
volume = {12},
number = {4},
pages = {1079--1092},
doi = {10.1109/tetc.2023.3346944}
}
EUVIMED