AutoGraph: Optimizing DNN Computation Graph for Parallel GPU Kernel Execution
Proceedings of the AAAI Conference on Artificial Intelligence · 26.06.2023 · 37 (9) · 11354-11362
DOI: 10.1609/aaai.v37i9.26343 ↗Kurz gefasst
Fachartikel in der Zeitschrift Proceedings of the AAAI Conference on Artificial Intelligence, online erschienen am 26.06.2023. Verfasst von Yuxuan Zhao und 4 weiteren Autor:innen. Die Arbeit wurde bisher 12-mal zitiert (Crossref).
Abstract (Originalsprache)
Deep learning frameworks optimize the computation graphs and intra-operator computations to boost the inference performance on GPUs, while inter-operator parallelism is usually ignored. In this paper, a unified framework, AutoGraph, is proposed to obtain highly optimized computation graphs in favor of parallel executions of GPU kernels. A novel dynamic programming algorithm, combined with backtracking search, is adopted to explore the optimal graph optimization solution, with the fast performance estimation from the mixed critical path cost. Accurate runtime information based on GPU Multi-Stream launched with CUDA Graph is utilized to determine the convergence of the optimization. Experimental results demonstrate that our method achieves up to 3.47x speedup over existing graph optimization methods. Moreover, AutoGraph outperforms state-of-the-art parallel kernel launch frameworks by up to 1.26x.
Zitieren
APA
Zhao, Y., Sun, Q., He, Z., Bai, Y., & Yu, B. (2023). AutoGraph: Optimizing DNN Computation Graph for Parallel GPU Kernel Execution. Proceedings of the AAAI Conference on Artificial Intelligence, 37(9), 11354-11362. https://doi.org/10.1609/aaai.v37i9.26343
Vancouver
Zhao Y, Sun Q, He Z, Bai Y, Yu B. AutoGraph: Optimizing DNN Computation Graph for Parallel GPU Kernel Execution. Proceedings of the AAAI Conference on Artificial Intelligence. 2023;37(9):11354-11362. doi:10.1609/aaai.v37i9.26343
BibTeX
@article{Zhao2023,
author = {Zhao, Yuxuan and Sun, Qi and He, Zhuolun and Bai, Yang and Yu, Bei},
title = {AutoGraph: Optimizing DNN Computation Graph for Parallel GPU Kernel Execution},
journal = {Proceedings of the AAAI Conference on Artificial Intelligence},
year = {2023},
volume = {37},
number = {9},
pages = {11354--11362},
doi = {10.1609/aaai.v37i9.26343}
}
EUVIMED