EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

LLM Fine-Tuning: Concepts, Opportunities, and Challenges

Xiao-Kun Wu, Min Chen, Wanyi Li, Rui Wang, Limeng Lu, Jia Liu, Kai Hwang, Yixue Hao, Yanru Pan, Qingguo Meng, Kaibin Huang, Long Hu und 7 weitere

Big Data and Cognitive Computing · 02.04.2025 · 9 (4) · 87

DOI: 10.3390/bdcc9040087 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Big Data and Cognitive Computing, online erschienen am 02.04.2025. Verfasst von Xiao-Kun Wu und 18 weiteren Autor:innen. Die Arbeit wurde bisher 100-mal zitiert (Crossref) und nennt 106 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Major Research Project of the National Social Science Foundation of China.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

As a foundation of large language models, fine-tuning drives rapid progress, broad applicability, and profound impacts on human–AI collaboration, surpassing earlier technological advancements. This paper provides a comprehensive overview of large language model (LLM) fine-tuning by integrating hermeneutic theories of human comprehension, with a focus on the essential cognitive conditions that underpin this process. Drawing on Gadamer’s concepts of Vorverständnis, Distanciation, and the Hermeneutic Circle, the paper explores how LLM fine-tuning evolves from initial learning to deeper comprehension, ultimately advancing toward self-awareness. It examines the core principles, development, and applications of fine-tuning techniques, emphasizing its growing significance across diverse field and industries. The paper introduces a new term, “Tutorial Fine-Tuning (TFT)”, which annotates a process of intensive tuition given by a “tutor” to a small number of “students”, to define the latest round of LLM fine-tuning advancements. By addressing key challenges associated with fine-tuning, including ensuring adaptability, precision, credibility and reliability, this paper explores potential future directions for the co-evolution of humans and AI. By bridging theoretical perspectives with practical implications, this work provides valuable insights into the ongoing development of LLMs, emphasizing their potential to achieve higher levels of cognitive and operational intelligence.

Förderung

  • Major Research Project of the National Social Science Foundation of China

Zitieren

APA

Wu, X., Chen, M., Li, W., Wang, R., Lu, L., Liu, J., Hwang, K., Hao, Y., Pan, Y., Meng, Q., Huang, K., Hu, L., Guizani, M., Chao, N., Fortino, G., Lin, F., Tian, Y., Niyato, D., & Wang, F. (2025). LLM Fine-Tuning: Concepts, Opportunities, and Challenges. Big Data and Cognitive Computing, 9(4), 87. https://doi.org/10.3390/bdcc9040087

Vancouver

Wu X, Chen M, Li W, Wang R, Lu L, Liu J, et al. LLM Fine-Tuning: Concepts, Opportunities, and Challenges. Big Data and Cognitive Computing. 2025;9(4):87. doi:10.3390/bdcc9040087

BibTeX
@article{Wu2025,
  author = {Wu, Xiao-Kun and Chen, Min and Li, Wanyi and Wang, Rui and Lu, Limeng and Liu, Jia and Hwang, Kai and Hao, Yixue and Pan, Yanru and Meng, Qingguo and Huang, Kaibin and Hu, Long and Guizani, Mohsen and Chao, Naipeng and Fortino, Giancarlo and Lin, Fei and Tian, Yonglin and Niyato, Dusit and Wang, Fei-Yue},
  title = {LLM Fine-Tuning: Concepts, Opportunities, and Challenges},
  journal = {Big Data and Cognitive Computing},
  year = {2025},
  volume = {9},
  number = {4},
  pages = {87},
  doi = {10.3390/bdcc9040087}
}
Kostenlos starten →