EUVIMEDEUVIMED entdecken
Crossref

Toward Energy-Efficient Collaborative Inference and Fine-Tuning: Matching Model Compression and Offloading With Resource Availability

Yuee Zhou, Lianbo Ma, Xingwei Wang, Qing Li, Carla Fabiana Chiasserini, Guangjie Han

IEEE Transactions on Networking · 2026 · 34 · 5127-5142

DOI: 10.1109/ton.2026.3689748 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Networking, 2026. Verfasst von Yuee Zhou und 5 weiteren Autor:innen. Die Arbeit nennt 55 Literaturangaben. Gefördert von: National Natural Science Foundation of China.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

We consider the collaborative inference acceleration task via cloud-edge-end collaboration, which involves a series of tightly coupled decision-making steps, including which DNN model to be selected, how much to compress model, how to partition model, and where to offload partitioned submodels. In practical deployments, these decisions jointly affect both fine-tuning and inference performance, and must jointly account for such aspects as the model being used, the computational resources and local datasets available at each device, as well as network latencies, which significantly increases the complexity of optimizing the problem. Yet, no existing studies focus on such joint optimization problem for these tightly coupled decisions. In this paper, we model this problem as a multi-dimensional optimization problem, jointly optimizing collaborative inference and fine-tuning by selecting the DNN model, compression level, partition strategy, and computational resource allocation, with the objective of minimizing the overall energy consumption of the learning-inference process, subject to accuracy and latency constraints. To this end, we propose an algorithmic framework called JQODI combining a time-energy tree diagram to represent the learning process, a dynamic programming solution strategy, and a data-driven theoretical approach to predict the expected total number of training epochs that meet the accuracy requirements. We prove that JQODI approximates the optimal solution with polynomial complexity. Numerical results demonstrate that JQODI surpasses state-of-the-art methods in both energy efficiency and latency.

Förderung

  • National Natural Science Foundation of China

Zitieren

APA

Zhou, Y., Ma, L., Wang, X., Li, Q., Chiasserini, C. F., & Han, G. (2026). Toward Energy-Efficient Collaborative Inference and Fine-Tuning: Matching Model Compression and Offloading With Resource Availability. IEEE Transactions on Networking, 34, 5127-5142. https://doi.org/10.1109/ton.2026.3689748

Vancouver

Zhou Y, Ma L, Wang X, Li Q, Chiasserini CF, Han G. Toward Energy-Efficient Collaborative Inference and Fine-Tuning: Matching Model Compression and Offloading With Resource Availability. IEEE Transactions on Networking. 2026;34:5127-5142. doi:10.1109/ton.2026.3689748

BibTeX
@article{Zhou2026,
  author = {Zhou, Yuee and Ma, Lianbo and Wang, Xingwei and Li, Qing and Chiasserini, Carla Fabiana and Han, Guangjie},
  title = {Toward Energy-Efficient Collaborative Inference and Fine-Tuning: Matching Model Compression and Offloading With Resource Availability},
  journal = {IEEE Transactions on Networking},
  year = {2026},
  volume = {34},
  pages = {5127--5142},
  doi = {10.1109/ton.2026.3689748}
}
Kostenlos starten →