EUVIMEDEUVIMED entdecken
Crossref

Resource-efficient Algorithms and Systems of Foundation Models: A Survey

Mengwei Xu, Dongqi Cai, Wangsong Yin, Shangguang Wang, Xin Jin, Xuanzhe Liu

ACM Computing Surveys · 31.05.2025 · 57 (5) · 1-39

DOI: 10.1145/3706418 ↗

Kurz gefasst

Fachartikel in der Zeitschrift ACM Computing Surveys, online erschienen am 09.01.2025. Verfasst von Mengwei Xu und 5 weiteren Autor:innen. Die Arbeit wurde bisher 48-mal zitiert (Crossref) und nennt 318 Literaturangaben. Gefördert von: NSFC.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Large foundation models, including large language models, vision transformers, diffusion, and large language model based multimodal models, are revolutionizing the entire machine learning lifecycle, from training to deployment. However, the substantial advancements in versatility and performance these models offer come at a significant cost in terms of hardware resources. To support the growth of these large models in a scalable and environmentally sustainable way, there has been a considerable focus on developing resource-efficient strategies. This survey delves into the critical importance of such research, examining both algorithmic and systemic aspects. It offers a comprehensive analysis and valuable insights gleaned from existing literature, encompassing a broad array of topics from cutting-edge model architectures and training/serving algorithms to practical system designs and implementations. The goal of this survey is to provide an overarching understanding of how current approaches are tackling the resource challenges posed by large foundation models and to potentially inspire future breakthroughs in this field.

Förderung

  • NSFC

Zitieren

APA

Xu, M., Cai, D., Yin, W., Wang, S., Jin, X., & Liu, X. (2025). Resource-efficient Algorithms and Systems of Foundation Models: A Survey. ACM Computing Surveys, 57(5), 1-39. https://doi.org/10.1145/3706418

Vancouver

Xu M, Cai D, Yin W, Wang S, Jin X, Liu X. Resource-efficient Algorithms and Systems of Foundation Models: A Survey. ACM Computing Surveys. 2025;57(5):1-39. doi:10.1145/3706418

BibTeX
@article{Xu2025,
  author = {Xu, Mengwei and Cai, Dongqi and Yin, Wangsong and Wang, Shangguang and Jin, Xin and Liu, Xuanzhe},
  title = {Resource-efficient Algorithms and Systems of Foundation Models: A Survey},
  journal = {ACM Computing Surveys},
  year = {2025},
  volume = {57},
  number = {5},
  pages = {1--39},
  doi = {10.1145/3706418}
}
Kostenlos starten →