EUVIMEDEUVIMED entdecken
Crossref

AutoGraph: Optimizing DNN Computation Graph for Parallel GPU Kernel Execution

Yuxuan Zhao, Qi Sun, Zhuolun He, Yang Bai, Bei Yu

Proceedings of the AAAI Conference on Artificial Intelligence · 26.06.2023 · 37 (9) · 11354-11362

DOI: 10.1609/aaai.v37i9.26343 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Proceedings of the AAAI Conference on Artificial Intelligence, online erschienen am 26.06.2023. Verfasst von Yuxuan Zhao und 4 weiteren Autor:innen. Die Arbeit wurde bisher 12-mal zitiert (Crossref).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Deep learning frameworks optimize the computation graphs and intra-operator computations to boost the inference performance on GPUs, while inter-operator parallelism is usually ignored. In this paper, a unified framework, AutoGraph, is proposed to obtain highly optimized computation graphs in favor of parallel executions of GPU kernels. A novel dynamic programming algorithm, combined with backtracking search, is adopted to explore the optimal graph optimization solution, with the fast performance estimation from the mixed critical path cost. Accurate runtime information based on GPU Multi-Stream launched with CUDA Graph is utilized to determine the convergence of the optimization. Experimental results demonstrate that our method achieves up to 3.47x speedup over existing graph optimization methods. Moreover, AutoGraph outperforms state-of-the-art parallel kernel launch frameworks by up to 1.26x.

Zitieren

APA

Zhao, Y., Sun, Q., He, Z., Bai, Y., & Yu, B. (2023). AutoGraph: Optimizing DNN Computation Graph for Parallel GPU Kernel Execution. Proceedings of the AAAI Conference on Artificial Intelligence, 37(9), 11354-11362. https://doi.org/10.1609/aaai.v37i9.26343

Vancouver

Zhao Y, Sun Q, He Z, Bai Y, Yu B. AutoGraph: Optimizing DNN Computation Graph for Parallel GPU Kernel Execution. Proceedings of the AAAI Conference on Artificial Intelligence. 2023;37(9):11354-11362. doi:10.1609/aaai.v37i9.26343

BibTeX
@article{Zhao2023,
  author = {Zhao, Yuxuan and Sun, Qi and He, Zhuolun and Bai, Yang and Yu, Bei},
  title = {AutoGraph: Optimizing DNN Computation Graph for Parallel GPU Kernel Execution},
  journal = {Proceedings of the AAAI Conference on Artificial Intelligence},
  year = {2023},
  volume = {37},
  number = {9},
  pages = {11354--11362},
  doi = {10.1609/aaai.v37i9.26343}
}
Kostenlos starten →