EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC-ND 4.0

Training and Serving System of Foundation Models: A Comprehensive Survey

Jiahang Zhou, Yanyu Chen, Zicong Hong, Wuhui Chen, Yue Yu, Tao Zhang, Hui Wang, Chuanfu Zhang, Zibin Zheng

IEEE Open Journal of the Computer Society · 2024 · 5 · 107-119

DOI: 10.1109/ojcs.2024.3380828 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Open Journal of the Computer Society, 2024. Verfasst von Jiahang Zhou und 8 weiteren Autor:innen. Die Arbeit wurde bisher 25-mal zitiert (Crossref) und nennt 97 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0). Gefördert von: National Key Research and Development Plan, National Natural Science Foundation of China, National Natural Science Foundation of Guangdong.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Foundation models (e.g., ChatGPT, DALL-E, PengCheng Mind, PanGu-$\Sigma$) have demonstrated extraordinary performance in key technological areas, such as natural language processing and visual recognition, and have become the mainstream trend of artificial general intelligence. This has led more and more major technology giants to dedicate significant human and financial resources to actively develop their foundation model systems, which drives continuous growth of these models' parameters. As a result, the training and serving of these models have posed significant challenges, including substantial computing power, memory consumption, bandwidth demands, etc. Therefore, employing efficient training and serving strategies becomes particularly crucial. Many researchers have actively explored and proposed effective methods. So, a comprehensive survey of them is essential for system developers and researchers. This paper extensively explores the methods employed in training and serving foundation models from various perspectives. It provides a detailed categorization of these state-of-the-art methods, including finer aspects such as network, computing, and storage. Additionally, the paper summarizes the challenges and presents a perspective on the future development direction of foundation model systems. Through comprehensive discussion and analysis, it hopes to provide a solid theoretical basis and practical guidance for future research and applications, promoting continuous innovation and development in foundation model systems.

Förderung

  • National Key Research and Development Plan
  • National Natural Science Foundation of China
  • National Natural Science Foundation of Guangdong
  • Major Key Project of PCL
  • CAAI-MindSpore Open Fund
  • Guangdong Provincial Pearl River Talents Program

Zitieren

APA

Zhou, J., Chen, Y., Hong, Z., Chen, W., Yu, Y., Zhang, T., Wang, H., Zhang, C., & Zheng, Z. (2024). Training and Serving System of Foundation Models: A Comprehensive Survey. IEEE Open Journal of the Computer Society, 5, 107-119. https://doi.org/10.1109/ojcs.2024.3380828

Vancouver

Zhou J, Chen Y, Hong Z, Chen W, Yu Y, Zhang T, et al. Training and Serving System of Foundation Models: A Comprehensive Survey. IEEE Open Journal of the Computer Society. 2024;5:107-119. doi:10.1109/ojcs.2024.3380828

BibTeX
@article{Zhou2024,
  author = {Zhou, Jiahang and Chen, Yanyu and Hong, Zicong and Chen, Wuhui and Yu, Yue and Zhang, Tao and Wang, Hui and Zhang, Chuanfu and Zheng, Zibin},
  title = {Training and Serving System of Foundation Models: A Comprehensive Survey},
  journal = {IEEE Open Journal of the Computer Society},
  year = {2024},
  volume = {5},
  pages = {107--119},
  doi = {10.1109/ojcs.2024.3380828}
}
Kostenlos starten →