Objective-Driven Differentiable Optimization of Traffic Prediction and Resource Allocation for Split AI Inference Edge Networks
IEEE Transactions on Machine Learning in Communications and Networking · 2024 · 2 · 1178-1192
DOI: 10.1109/tmlcn.2024.3449831 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Machine Learning in Communications and Networking, 2024. Verfasst von Xinchen Lyu und 7 weiteren Autor:innen. Die Arbeit wurde bisher 9-mal zitiert (Crossref) und nennt 52 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Key Research and Development Program of China, National Natural Science Foundation of China, Fundamental Research Funds for the Central Universities.
Abstract (Originalsprache)
Split AI inference partitions an artificial intelligence (AI) model into multiple parts, enabling the offloading of computation-intensive AI services. Resource allocation is critical for the performance of split AI inference. The challenge arises from the time-sensitivity of many services versus time-varying traffic arrivals and network conditions. The conventional prediction-based resource allocation frameworks have adopted separate traffic prediction and resource optimization modules, which may be inefficient due to discrepancies between the traffic prediction accuracy and resource optimization objective. This paper proposes a new, objective-driven, differentiable optimization framework that integrates traffic prediction and resource allocation for split AI inference. The resource optimization problem (aimed to maximize network revenue while adhering to service and network constraints) is designed to be embedded as the output layer following the traffic prediction module. As such, the traffic prediction module can be trained directly based on the network revenue instead of the prediction accuracy, significantly outperforming the conventional prediction-based separate design. Employing the Lagrange duality and Karush-Kuhn-Tucker (KKT) conditions, we achieve efficient forward pass (obtaining resource allocation decisions) and backpropagation (deriving the objective-driven gradients for joint model training) of the output layer. Extensive experiments on different traffic datasets validate the superiority of the proposed approach, achieving up to 38.85% higher network revenue than the conventional predictive baselines.
Förderung
- National Key Research and Development Program of China
- National Natural Science Foundation of China
- Fundamental Research Funds for the Central Universities
- Joint Funds for Regional Innovation and Development of the National Natural Science Foundation of China
Zitieren
APA
Lyu, X., Li, Y., He, Y., Ren, C., Ni, W., Liu, R. P., Zhu, P., & Cui, Q. (2024). Objective-Driven Differentiable Optimization of Traffic Prediction and Resource Allocation for Split AI Inference Edge Networks. IEEE Transactions on Machine Learning in Communications and Networking, 2, 1178-1192. https://doi.org/10.1109/tmlcn.2024.3449831
Vancouver
Lyu X, Li Y, He Y, Ren C, Ni W, Liu RP, et al. Objective-Driven Differentiable Optimization of Traffic Prediction and Resource Allocation for Split AI Inference Edge Networks. IEEE Transactions on Machine Learning in Communications and Networking. 2024;2:1178-1192. doi:10.1109/tmlcn.2024.3449831
BibTeX
@article{Lyu2024,
author = {Lyu, Xinchen and Li, Yuewei and He, Ying and Ren, Chenshan and Ni, Wei and Liu, Ren Ping and Zhu, Pengcheng and Cui, Qimei},
title = {Objective-Driven Differentiable Optimization of Traffic Prediction and Resource Allocation for Split AI Inference Edge Networks},
journal = {IEEE Transactions on Machine Learning in Communications and Networking},
year = {2024},
volume = {2},
pages = {1178--1192},
doi = {10.1109/tmlcn.2024.3449831}
}
EUVIMED