EUVIMEDEUVIMED entdecken
Crossref

Workload-Aware Performance Model Based Soft Preemptive Real-Time Scheduling for Neural Processing Units

Yuan Yao, Yujiao Hu, Yi Dang, Wei Tao, Kai Hu, Qiming Huang, Zhe Peng, Gang Yang, Xingshe Zhou

IEEE Transactions on Parallel and Distributed Systems · 2025-06 · 36 (6) · 1058-1070

DOI: 10.1109/tpds.2025.3553922 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Parallel and Distributed Systems, 2025-06. Verfasst von Yuan Yao und 8 weiteren Autor:innen. Die Arbeit wurde bisher 12-mal zitiert (Crossref) und nennt 35 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Hong Kong Research Grants Council General Research, Shenzhen Science and Technology Program.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

A neural processing unit (NPU) is a microprocessor which is specially designed for various types of neural network applications. Because of its high acceleration efficiency and lower power consumption, the airborne embedded system has widely deployed NPU to replace GPU as the new accelerator. Unfortunately, the inherent scheduler of NPU does not consider real-time scheduling. Therefore, it cannot meet real-time requirements of airborne embedded systems. At present, there is less research on the multi-task real-time scheduling of the NPU device. In this article, we first design an NPU resource management framework based on Kubernetes. Then, we propose WAMSPRES, a workload-aware NPU performance model based soft preemptive real-time scheduling method. The proposed workload-aware NPU performance model can accurately predict the remaining execution time of the task when it runs with other tasks concurrently. The soft preemptive real-time scheduling algorithm can provide approximate preemption capability by dynamically adjusting the NPU computing resources of tasks. Finally, we implement a prototype NPU scheduler of the airborne embedded system for the fixed-wing UAV. The proposed models and algorithms are validated on both the simulated and realistic task sets. Experimental results illustrate that WAMSPRES can achieve low prediction error and high scheduling success rate.

Förderung

  • National Natural Science Foundation of China
  • Hong Kong Research Grants Council General Research
  • Shenzhen Science and Technology Program
  • Aeronautical Science Foundation of China

Zitieren

APA

Yao, Y., Hu, Y., Dang, Y., Tao, W., Hu, K., Huang, Q., Peng, Z., Yang, G., & Zhou, X. (2025). Workload-Aware Performance Model Based Soft Preemptive Real-Time Scheduling for Neural Processing Units. IEEE Transactions on Parallel and Distributed Systems, 36(6), 1058-1070. https://doi.org/10.1109/tpds.2025.3553922

Vancouver

Yao Y, Hu Y, Dang Y, Tao W, Hu K, Huang Q, et al. Workload-Aware Performance Model Based Soft Preemptive Real-Time Scheduling for Neural Processing Units. IEEE Transactions on Parallel and Distributed Systems. 2025;36(6):1058-1070. doi:10.1109/tpds.2025.3553922

BibTeX
@article{Yao2025,
  author = {Yao, Yuan and Hu, Yujiao and Dang, Yi and Tao, Wei and Hu, Kai and Huang, Qiming and Peng, Zhe and Yang, Gang and Zhou, Xingshe},
  title = {Workload-Aware Performance Model Based Soft Preemptive Real-Time Scheduling for Neural Processing Units},
  journal = {IEEE Transactions on Parallel and Distributed Systems},
  year = {2025},
  volume = {36},
  number = {6},
  pages = {1058--1070},
  doi = {10.1109/tpds.2025.3553922}
}
Kostenlos starten →