EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

A Survey on Model Compression for Large Language Models

Xunyu Zhu, Jian Li, Yong Liu, Can Ma, Weiping Wang

Transactions of the Association for Computational Linguistics · 27.11.2024 · 12 · 1556-1577

DOI: 10.1162/tacl_a_00704 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Transactions of the Association for Computational Linguistics, online erschienen am 27.11.2024. Verfasst von Xunyu Zhu und 4 weiteren Autor:innen. Die Arbeit wurde bisher 250-mal zitiert (Crossref) und nennt 111 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Large Language Models (LLMs) have transformed natural language processing tasks successfully. Yet, their large size and high computational needs pose challenges for practical use, especially in resource-limited settings. Model compression has emerged as a key research area to address these challenges. This paper presents a survey of model compression techniques for LLMs. We cover methods like quantization, pruning, and knowledge distillation, highlighting recent advancements. We also discuss benchmarking strategies and evaluation metrics crucial for assessing compressed LLMs. This survey offers valuable insights for researchers and practitioners, aiming to enhance efficiency and real-world applicability of LLMs while laying a foundation for future advancements.

Zitieren

APA

Zhu, X., Li, J., Liu, Y., Ma, C., & Wang, W. (2024). A Survey on Model Compression for Large Language Models. Transactions of the Association for Computational Linguistics, 12, 1556-1577. https://doi.org/10.1162/tacl_a_00704

Vancouver

Zhu X, Li J, Liu Y, Ma C, Wang W. A Survey on Model Compression for Large Language Models. Transactions of the Association for Computational Linguistics. 2024;12:1556-1577. doi:10.1162/tacl_a_00704

BibTeX
@article{Zhu2024,
  author = {Zhu, Xunyu and Li, Jian and Liu, Yong and Ma, Can and Wang, Weiping},
  title = {A Survey on Model Compression for Large Language Models},
  journal = {Transactions of the Association for Computational Linguistics},
  year = {2024},
  volume = {12},
  pages = {1556--1577},
  doi = {10.1162/tacl_a_00704}
}
Kostenlos starten →