EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Optimization of Direct Convolution Algorithms on ARM Processors for Deep Learning Inference

Shang Li, Fei Yu, Shankou Zhang, Huige Yin, Hairong Lin

Mathematics · 27.02.2025 · 13 (5) · 787

DOI: 10.3390/math13050787 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Mathematics, online erschienen am 27.02.2025. Verfasst von Shang Li und 4 weiteren Autor:innen. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 54 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Key Research and Development Program “National Quality Infrastructure System” Special Project, Hefei Minglong Electronic Technology Co., Ltd..

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

In deep learning, convolutional layers typically bear the majority of the computational workload and are often the primary contributors to performance bottlenecks. The widely used convolution algorithm is based on the IM2COL transform to take advantage of the highly optimized GEMM (General Matrix Multiplication) kernel acceleration, using the highly optimized BLAS (Basic Linear Algebra Subroutine) library, which tends to incur additional memory overhead. Recent studies have indicated that direct convolution approaches can outperform traditional convolution implementations without additional memory overhead. In this paper, we propose a high-performance implementation of the direct convolution algorithm for inference that preserves the channel-first data layout of the convolutional layer inputs/outputs. We evaluate the performance of our proposed algorithm on a multi-core ARM CPU platform and compare it with state-of-the-art convolution optimization techniques. Experimental results demonstrate that our new algorithm performs better across the evaluated scenarios and platforms.

Förderung

  • National Key Research and Development Program “National Quality Infrastructure System” Special Project
  • Hefei Minglong Electronic Technology Co., Ltd.

Zitieren

APA

Li, S., Yu, F., Zhang, S., Yin, H., & Lin, H. (2025). Optimization of Direct Convolution Algorithms on ARM Processors for Deep Learning Inference. Mathematics, 13(5), 787. https://doi.org/10.3390/math13050787

Vancouver

Li S, Yu F, Zhang S, Yin H, Lin H. Optimization of Direct Convolution Algorithms on ARM Processors for Deep Learning Inference. Mathematics. 2025;13(5):787. doi:10.3390/math13050787

BibTeX
@article{Li2025,
  author = {Li, Shang and Yu, Fei and Zhang, Shankou and Yin, Huige and Lin, Hairong},
  title = {Optimization of Direct Convolution Algorithms on ARM Processors for Deep Learning Inference},
  journal = {Mathematics},
  year = {2025},
  volume = {13},
  number = {5},
  pages = {787},
  doi = {10.3390/math13050787}
}
Kostenlos starten →