Toward Energy-Efficient Collaborative Inference and Fine-Tuning: Matching Model Compression and Offloading With Resource Availability
IEEE Transactions on Networking · 2026 · 34 · 5127-5142
DOI: 10.1109/ton.2026.3689748 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Networking, 2026. Verfasst von Yuee Zhou und 5 weiteren Autor:innen. Die Arbeit nennt 55 Literaturangaben. Gefördert von: National Natural Science Foundation of China.
Abstract (Originalsprache)
We consider the collaborative inference acceleration task via cloud-edge-end collaboration, which involves a series of tightly coupled decision-making steps, including which DNN model to be selected, how much to compress model, how to partition model, and where to offload partitioned submodels. In practical deployments, these decisions jointly affect both fine-tuning and inference performance, and must jointly account for such aspects as the model being used, the computational resources and local datasets available at each device, as well as network latencies, which significantly increases the complexity of optimizing the problem. Yet, no existing studies focus on such joint optimization problem for these tightly coupled decisions. In this paper, we model this problem as a multi-dimensional optimization problem, jointly optimizing collaborative inference and fine-tuning by selecting the DNN model, compression level, partition strategy, and computational resource allocation, with the objective of minimizing the overall energy consumption of the learning-inference process, subject to accuracy and latency constraints. To this end, we propose an algorithmic framework called JQODI combining a time-energy tree diagram to represent the learning process, a dynamic programming solution strategy, and a data-driven theoretical approach to predict the expected total number of training epochs that meet the accuracy requirements. We prove that JQODI approximates the optimal solution with polynomial complexity. Numerical results demonstrate that JQODI surpasses state-of-the-art methods in both energy efficiency and latency.
Förderung
- National Natural Science Foundation of China
Zitieren
APA
Zhou, Y., Ma, L., Wang, X., Li, Q., Chiasserini, C. F., & Han, G. (2026). Toward Energy-Efficient Collaborative Inference and Fine-Tuning: Matching Model Compression and Offloading With Resource Availability. IEEE Transactions on Networking, 34, 5127-5142. https://doi.org/10.1109/ton.2026.3689748
Vancouver
Zhou Y, Ma L, Wang X, Li Q, Chiasserini CF, Han G. Toward Energy-Efficient Collaborative Inference and Fine-Tuning: Matching Model Compression and Offloading With Resource Availability. IEEE Transactions on Networking. 2026;34:5127-5142. doi:10.1109/ton.2026.3689748
BibTeX
@article{Zhou2026,
author = {Zhou, Yuee and Ma, Lianbo and Wang, Xingwei and Li, Qing and Chiasserini, Carla Fabiana and Han, Guangjie},
title = {Toward Energy-Efficient Collaborative Inference and Fine-Tuning: Matching Model Compression and Offloading With Resource Availability},
journal = {IEEE Transactions on Networking},
year = {2026},
volume = {34},
pages = {5127--5142},
doi = {10.1109/ton.2026.3689748}
}
EUVIMED