Optimization of Direct Convolution Algorithms on ARM Processors for Deep Learning Inference
Mathematics · 2025-02-27 · 13 (5) · 787
DOI: 10.3390/math13050787 ↗At a glance
Journal article in Mathematics, published online on 2025-02-27. Written by Shang Li and 4 co-authors. Cited 2 times so far (Crossref); 54 references. The full text is freely available (open access, CC BY 4.0). Funded by: National Key Research and Development Program “National Quality Infrastructure System” Special Project, Hefei Minglong Electronic Technology Co., Ltd..
Abstract (original language)
In deep learning, convolutional layers typically bear the majority of the computational workload and are often the primary contributors to performance bottlenecks. The widely used convolution algorithm is based on the IM2COL transform to take advantage of the highly optimized GEMM (General Matrix Multiplication) kernel acceleration, using the highly optimized BLAS (Basic Linear Algebra Subroutine) library, which tends to incur additional memory overhead. Recent studies have indicated that direct convolution approaches can outperform traditional convolution implementations without additional memory overhead. In this paper, we propose a high-performance implementation of the direct convolution algorithm for inference that preserves the channel-first data layout of the convolutional layer inputs/outputs. We evaluate the performance of our proposed algorithm on a multi-core ARM CPU platform and compare it with state-of-the-art convolution optimization techniques. Experimental results demonstrate that our new algorithm performs better across the evaluated scenarios and platforms.
Funding
- National Key Research and Development Program “National Quality Infrastructure System” Special Project
- Hefei Minglong Electronic Technology Co., Ltd.
Cite
APA
Li, S., Yu, F., Zhang, S., Yin, H., & Lin, H. (2025). Optimization of Direct Convolution Algorithms on ARM Processors for Deep Learning Inference. Mathematics, 13(5), 787. https://doi.org/10.3390/math13050787
Vancouver
Li S, Yu F, Zhang S, Yin H, Lin H. Optimization of Direct Convolution Algorithms on ARM Processors for Deep Learning Inference. Mathematics. 2025;13(5):787. doi:10.3390/math13050787
BibTeX
@article{Li2025,
author = {Li, Shang and Yu, Fei and Zhang, Shankou and Yin, Huige and Lin, Hairong},
title = {Optimization of Direct Convolution Algorithms on ARM Processors for Deep Learning Inference},
journal = {Mathematics},
year = {2025},
volume = {13},
number = {5},
pages = {787},
doi = {10.3390/math13050787}
}
EUVIMED