An Edge-Cloud Collaboration Framework for Generative AI Service Provision With Synergetic Big Cloud Model and Small Edge Models
IEEE Network · 2024-09 · 38 (5) · 37-46
DOI: 10.1109/mnet.2024.3420755 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Network, 2024-09. Verfasst von Yuqing Tian und 7 weiteren Autor:innen. Die Arbeit wurde bisher 60-mal zitiert (Crossref) und nennt 15 Literaturangaben. Gefördert von: National Key Research and Development Program of China, National Natural Science Foundation of China, Provincial Key R&D Program of Zhejiang.
Abstract (Originalsprache)
Generative artificial intelligence (GenAI) offers various services to users through content creation, which is believed to be one of the most important components in future networks. However, training and deploying big artificial intelligence models (BAIMs) introduces substantial computational and communication overhead. This poses a critical challenge to centralized approaches, due to the need of high-performance computing infrastructure and the reliability, secrecy and timeliness issues in long-distance access of cloud services. Therefore, there is an urging need to decentralize the services, partly moving them from the cloud to the edge and establishing native GenAI services to enable private, timely, and personalized experiences. In this paper, we propose a brand-new bottom-up BAIM architecture with synergetic big cloud model and small edge models, and design a distributed training framework and a task-oriented deployment scheme for efficient provision of native GenAI services. The proposed framework can facilitate collaborative intelligence, enhance adaptability, gather edge knowledge and alleviate edge-cloud burden. The effectiveness of the proposed framework is demonstrated through an image generation use case. Finally, we outline fundamental research directions to fully exploit the collaborative potential of edge and cloud for native GenAI and BAIM applications.
Förderung
- National Key Research and Development Program of China
- National Natural Science Foundation of China
- Provincial Key R&D Program of Zhejiang
Zitieren
APA
Tian, Y., Zhang, Z., Yang, Y., Chen, Z., Yang, Z., Jin, R., Quek, T. Q. S., & Wong, K. (2024). An Edge-Cloud Collaboration Framework for Generative AI Service Provision With Synergetic Big Cloud Model and Small Edge Models. IEEE Network, 38(5), 37-46. https://doi.org/10.1109/mnet.2024.3420755
Vancouver
Tian Y, Zhang Z, Yang Y, Chen Z, Yang Z, Jin R, et al. An Edge-Cloud Collaboration Framework for Generative AI Service Provision With Synergetic Big Cloud Model and Small Edge Models. IEEE Network. 2024;38(5):37-46. doi:10.1109/mnet.2024.3420755
BibTeX
@article{Tian2024,
author = {Tian, Yuqing and Zhang, Zhaoyang and Yang, Yuzhi and Chen, Zirui and Yang, Zhaohui and Jin, Richeng and Quek, Tony Q. S. and Wong, Kai-Kit},
title = {An Edge-Cloud Collaboration Framework for Generative AI Service Provision With Synergetic Big Cloud Model and Small Edge Models},
journal = {IEEE Network},
year = {2024},
volume = {38},
number = {5},
pages = {37--46},
doi = {10.1109/mnet.2024.3420755}
}
EUVIMED