EUVIMEDEUVIMED entdecken
Crossref

Static Scheduling of Weight Programming for DNN Acceleration with Resource Constrained PIM

Xin Gao, Hongyue Wang, Yiyan Chen, Yuhao Zhang, Zhaoyan Shen, Lei Ju

ACM Transactions on Embedded Computing Systems · 30.11.2024 · 23 (6) · 1-22

DOI: 10.1145/3615657 ↗

Kurz gefasst

Fachartikel in der Zeitschrift ACM Transactions on Embedded Computing Systems, online erschienen am 11.09.2024. Verfasst von Xin Gao und 5 weiteren Autor:innen. Die Arbeit wurde bisher 5-mal zitiert (Crossref) und nennt 45 Literaturangaben. Gefördert von: Natural Science Foundation of China, Taishan Scholars Program, and Qilu Young Scholar Program of Shandong University.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Most existing architectural studies on ReRAM-based processing-in-memory (PIM) DNN accelerators assume that all weights of the DNN can be mapped to the crossbar at once. However, these studies are over-idealized. ReRAM crossbar resources for calculation are limited because of technological limitations, so multiple weight mapping procedures are required during the inference process. In this article, we propose a static scheduling framework which generates the mapping between DNN weights and ReRAM cells with minimum runtime weight programming cost. We first build a ReRAM crossbar programming latency model by simultaneously considering the DNN weight patterns, ReRAM programming operations, and PIM architecture characteristics. Then, the model is used in the searching process to obtain an optimized weight-to-OU mapping table with minimum online programming latency. Finally, an OU scheduler is used to coordinate the activation sequences of OUs in the crossbars to perform the inference computation correctly. Evaluation results show the proposed framework significantly reduces the weight programming overhead and the overall inference latency for various DNN models with different input datasets.

Förderung

  • Natural Science Foundation of China
  • Taishan Scholars Program, and Qilu Young Scholar Program of Shandong University

Zitieren

APA

Gao, X., Wang, H., Chen, Y., Zhang, Y., Shen, Z., & Ju, L. (2024). Static Scheduling of Weight Programming for DNN Acceleration with Resource Constrained PIM. ACM Transactions on Embedded Computing Systems, 23(6), 1-22. https://doi.org/10.1145/3615657

Vancouver

Gao X, Wang H, Chen Y, Zhang Y, Shen Z, Ju L. Static Scheduling of Weight Programming for DNN Acceleration with Resource Constrained PIM. ACM Transactions on Embedded Computing Systems. 2024;23(6):1-22. doi:10.1145/3615657

BibTeX
@article{Gao2024,
  author = {Gao, Xin and Wang, Hongyue and Chen, Yiyan and Zhang, Yuhao and Shen, Zhaoyan and Ju, Lei},
  title = {Static Scheduling of Weight Programming for DNN Acceleration with Resource Constrained PIM},
  journal = {ACM Transactions on Embedded Computing Systems},
  year = {2024},
  volume = {23},
  number = {6},
  pages = {1--22},
  doi = {10.1145/3615657}
}
Kostenlos starten →