EUVIMEDEUVIMED entdecken
Crossref

Thermal-Aware Scheduling for Deep Learning on Mobile Devices With NPU

Tianxiang Tan, Guohong Cao

IEEE Transactions on Mobile Computing · 2024-12 · 23 (12) · 10706-10719

DOI: 10.1109/tmc.2024.3379501 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Mobile Computing, 2024-12. Verfasst von Tianxiang Tan und 1 weiteren Autor:innen. Die Arbeit wurde bisher 31-mal zitiert (Crossref) und nennt 52 Literaturangaben. Gefördert von: National Science Foundation.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

As Deep Neural Networks (DNNs) have been successfully applied to various fields, there is a tremendous demand for running DNNs on mobile devices. Although mobile GPU can be leveraged to improve performance, it consumes a large amount of energy. After a short period of time, the mobile device may become overheated and the processors are forced to reduce the clock speed, significantly reducing the processing speed. A different approach to support DNNs on mobile device is to leverage the Neural Processing Units (NPUs). Compared to GPU, NPU is much faster and more energy efficient, but with lower accuracy due to the use of low precision floating-point numbers. We propose to combine these two approaches to improve the performance of running DNNs on mobile devices by studying the thermal-aware scheduling problem, where the goal is to achieve a better tradeoff between processing time and accuracy while ensuring that the mobile device is not overheated. To solve the problem, we propose a heuristic-based scheduling algorithm to determine when to run DNNs on GPU and when to run DNNs on NPU based on the current states of the mobile device. The heuristic-based algorithm makes scheduling decisions greedily and ignores their future impacts. Thus, we propose a deep reinforcement learning based scheduling algorithm to further improve performance. Extensive evaluation results show that the proposed algorithms can significantly improve the performance of running DNNs on mobile devices while avoiding overheating.

Förderung

  • National Science Foundation

Zitieren

APA

Tan, T., & Cao, G. (2024). Thermal-Aware Scheduling for Deep Learning on Mobile Devices With NPU. IEEE Transactions on Mobile Computing, 23(12), 10706-10719. https://doi.org/10.1109/tmc.2024.3379501

Vancouver

Tan T, Cao G. Thermal-Aware Scheduling for Deep Learning on Mobile Devices With NPU. IEEE Transactions on Mobile Computing. 2024;23(12):10706-10719. doi:10.1109/tmc.2024.3379501

BibTeX
@article{Tan2024,
  author = {Tan, Tianxiang and Cao, Guohong},
  title = {Thermal-Aware Scheduling for Deep Learning on Mobile Devices With NPU},
  journal = {IEEE Transactions on Mobile Computing},
  year = {2024},
  volume = {23},
  number = {12},
  pages = {10706--10719},
  doi = {10.1109/tmc.2024.3379501}
}
Kostenlos starten →