EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Quantization-Based Optimization Algorithm for Hardware Implementation of Convolution Neural Networks

Bassam J. Mohd, Khalil M. Ahmad Yousef, Anas AlMajali, Thaier Hayajneh

Electronics · 30.04.2024 · 13 (9) · 1727

DOI: 10.3390/electronics13091727 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Electronics, online erschienen am 30.04.2024. Verfasst von Bassam J. Mohd und 3 weiteren Autor:innen. Die Arbeit wurde bisher 10-mal zitiert (Crossref) und nennt 68 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Convolutional neural networks (CNNs) have demonstrated remarkable performance in many areas but require significant computation and storage resources. Quantization is an effective method to reduce CNN complexity and implementation. The main research objective is to develop a scalable quantization algorithm for CNN hardware design and model the performance metrics for the purpose of CNN implementation in resource-constrained devices (RCDs) and optimizing layers in deep neural networks (DNNs). The algorithm novelty is based on blending two quantization techniques to perform full model quantization with optimum accuracy, and without additional neurons. The algorithm is applied to a selected CNN model and implemented on an FPGA. Implementing CNN using broad data is not possible due to capacity issues. With the proposed quantization algorithm, we succeeded in implementing the model on the FPGA using 16-, 12-, and 8-bit quantization. Compared to the 16-bit design, the 8-bit design offers a 44% decrease in resource utilization, and achieves power and energy reductions of 41% and 42%, respectively. Models show that trading off one quantization bit yields savings of approximately 5.4K LUTs, 4% logic utilization, 46.9 mW power, and 147 μJ energy. The models were also used to estimate performance metrics for a sample DNN design.

Zitieren

APA

Mohd, B. J., Yousef, K. M. A., AlMajali, A., & Hayajneh, T. (2024). Quantization-Based Optimization Algorithm for Hardware Implementation of Convolution Neural Networks. Electronics, 13(9), 1727. https://doi.org/10.3390/electronics13091727

Vancouver

Mohd BJ, Yousef KMA, AlMajali A, Hayajneh T. Quantization-Based Optimization Algorithm for Hardware Implementation of Convolution Neural Networks. Electronics. 2024;13(9):1727. doi:10.3390/electronics13091727

BibTeX
@article{Mohd2024,
  author = {Mohd, Bassam J. and Yousef, Khalil M. Ahmad and AlMajali, Anas and Hayajneh, Thaier},
  title = {Quantization-Based Optimization Algorithm for Hardware Implementation of Convolution Neural Networks},
  journal = {Electronics},
  year = {2024},
  volume = {13},
  number = {9},
  pages = {1727},
  doi = {10.3390/electronics13091727}
}
Kostenlos starten →