EUVIMEDEUVIMED entdecken
Crossref

Joint Pruning and Channel-Wise Mixed-Precision Quantization for Efficient Deep Neural Networks

Beatrice Alessandra Motetti, Matteo Risso, Alessio Burrello, Enrico Macii, Massimo Poncino, Daniele Jahier Pagliari

IEEE Transactions on Computers · 2024-11 · 73 (11) · 2619-2633

DOI: 10.1109/tc.2024.3449084 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Computers, 2024-11. Verfasst von Beatrice Alessandra Motetti und 5 weiteren Autor:innen. Die Arbeit wurde bisher 33-mal zitiert (Crossref) und nennt 45 Literaturangaben. Gefördert von: PNRR-NGEU, Key Digital Technologies Joint Undertaking, European Union’s Horizon Europe research and innovation programme.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The resource requirements of deep neural networks (DNNs) pose significant challenges to their deployment on edge devices. Common approaches to address this issue are pruning and mixed-precision quantization, which lead to latency and memory occupation improvements. These optimization techniques are usually applied independently. We propose a novel methodology to apply them jointly via a lightweight gradient-based search, and in a hardware-aware manner, greatly reducing the time required to generate Pareto-optimal DNNs in terms of accuracy versus cost (i.e., latency or memory). We test our approach on three edge-relevant benchmarks, namely CIFAR-10, Google Speech Commands, and Tiny ImageNet. When targeting the optimization of the memory footprint, we are able to achieve a size reduction of 47.50% and 69.54% at iso-accuracy with the baseline networks with all weights quantized at 8 and 2-bit, respectively. Our method surpasses a previous state-of-the-art approach with up to 56.17% size reduction at iso-accuracy. With respect to the sequential application of state-of-the-art pruning and mixed-precision optimizations, we obtain comparable or superior results, but with a significantly lowered training time. In addition, we show how well-tailored cost models can improve the cost versus accuracy trade-offs when targeting specific hardware for deployment.

Förderung

  • PNRR-NGEU
  • Key Digital Technologies Joint Undertaking
  • European Union’s Horizon Europe research and innovation programme

Zitieren

APA

Motetti, B. A., Risso, M., Burrello, A., Macii, E., Poncino, M., & Pagliari, D. J. (2024). Joint Pruning and Channel-Wise Mixed-Precision Quantization for Efficient Deep Neural Networks. IEEE Transactions on Computers, 73(11), 2619-2633. https://doi.org/10.1109/tc.2024.3449084

Vancouver

Motetti BA, Risso M, Burrello A, Macii E, Poncino M, Pagliari DJ. Joint Pruning and Channel-Wise Mixed-Precision Quantization for Efficient Deep Neural Networks. IEEE Transactions on Computers. 2024;73(11):2619-2633. doi:10.1109/tc.2024.3449084

BibTeX
@article{Motetti2024,
  author = {Motetti, Beatrice Alessandra and Risso, Matteo and Burrello, Alessio and Macii, Enrico and Poncino, Massimo and Pagliari, Daniele Jahier},
  title = {Joint Pruning and Channel-Wise Mixed-Precision Quantization for Efficient Deep Neural Networks},
  journal = {IEEE Transactions on Computers},
  year = {2024},
  volume = {73},
  number = {11},
  pages = {2619--2633},
  doi = {10.1109/tc.2024.3449084}
}
Kostenlos starten →