Accelerating DNN Inference With Reliability Guarantee in Vehicular Edge Computing
IEEE/ACM Transactions on Networking · 2023-12 · 31 (6) · 3238-3253
DOI: 10.1109/tnet.2023.3279512 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE/ACM Transactions on Networking, 2023-12. Verfasst von Kai Liu und 4 weiteren Autor:innen. Die Arbeit wurde bisher 86-mal zitiert (Crossref) und nennt 37 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Chongqing Young-Talent Program.
Abstract (Originalsprache)
This paper explores on accelerating Deep Neural Network (DNN) inference with reliability guarantee in Vehicular Edge Computing (VEC) by considering the synergistic impacts of vehicle mobility and Vehicle-to-Vehicle/Infrastructure (V2V/V2I) communications. First, we show the necessity of striking a balance between DNN inference acceleration and reliability in VEC, and give insights into the design rationale by analyzing the features of overlapped DNN partitioning and mobility-aware task offloading. Second, we formulate the Cooperative Partitioning and Offloading (CPO) problem by presenting a cooperative DNN partitioning and offloading scenario, followed by deriving an offloading reliability model and a DNN inference delay model. The CPO is proved as NP-hard. Third, we propose two approximation algorithms, i.e., Submodular Approximation Allocation Algorithm (SA3) and Feed Me the Rest algorithm (FMtR). In particular, SA3 determines the edge allocation in a centralized way, which achieves 1/3-optimal approximation on maximizing the inference reliability. On this basis, FMtR partitions the DNN models and offloads the tasks to the allocated edge nodes in a distributed way, which achieves 1/2-optimal approximation on maximizing the inference reliability. Finally, we build the simulation model and give a comprehensive performance evaluation, which demonstrates the superiority of the proposed solutions.
Förderung
- National Natural Science Foundation of China
- Chongqing Young-Talent Program
Zitieren
APA
Liu, K., Liu, C., Yan, G., Lee, V. C. S., & Cao, J. (2023). Accelerating DNN Inference With Reliability Guarantee in Vehicular Edge Computing. IEEE/ACM Transactions on Networking, 31(6), 3238-3253. https://doi.org/10.1109/tnet.2023.3279512
Vancouver
Liu K, Liu C, Yan G, Lee VCS, Cao J. Accelerating DNN Inference With Reliability Guarantee in Vehicular Edge Computing. IEEE/ACM Transactions on Networking. 2023;31(6):3238-3253. doi:10.1109/tnet.2023.3279512
BibTeX
@article{Liu2023,
author = {Liu, Kai and Liu, Chunhui and Yan, Guozhi and Lee, Victor C. S. and Cao, Jiannong},
title = {Accelerating DNN Inference With Reliability Guarantee in Vehicular Edge Computing},
journal = {IEEE/ACM Transactions on Networking},
year = {2023},
volume = {31},
number = {6},
pages = {3238--3253},
doi = {10.1109/tnet.2023.3279512}
}
EUVIMED