LLM Fine-Tuning: Concepts, Opportunities, and Challenges
Big Data and Cognitive Computing · 02.04.2025 · 9 (4) · 87
DOI: 10.3390/bdcc9040087 ↗Kurz gefasst
Fachartikel in der Zeitschrift Big Data and Cognitive Computing, online erschienen am 02.04.2025. Verfasst von Xiao-Kun Wu und 18 weiteren Autor:innen. Die Arbeit wurde bisher 100-mal zitiert (Crossref) und nennt 106 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Major Research Project of the National Social Science Foundation of China.
Abstract (Originalsprache)
As a foundation of large language models, fine-tuning drives rapid progress, broad applicability, and profound impacts on human–AI collaboration, surpassing earlier technological advancements. This paper provides a comprehensive overview of large language model (LLM) fine-tuning by integrating hermeneutic theories of human comprehension, with a focus on the essential cognitive conditions that underpin this process. Drawing on Gadamer’s concepts of Vorverständnis, Distanciation, and the Hermeneutic Circle, the paper explores how LLM fine-tuning evolves from initial learning to deeper comprehension, ultimately advancing toward self-awareness. It examines the core principles, development, and applications of fine-tuning techniques, emphasizing its growing significance across diverse field and industries. The paper introduces a new term, “Tutorial Fine-Tuning (TFT)”, which annotates a process of intensive tuition given by a “tutor” to a small number of “students”, to define the latest round of LLM fine-tuning advancements. By addressing key challenges associated with fine-tuning, including ensuring adaptability, precision, credibility and reliability, this paper explores potential future directions for the co-evolution of humans and AI. By bridging theoretical perspectives with practical implications, this work provides valuable insights into the ongoing development of LLMs, emphasizing their potential to achieve higher levels of cognitive and operational intelligence.
Förderung
- Major Research Project of the National Social Science Foundation of China
Zitieren
APA
Wu, X., Chen, M., Li, W., Wang, R., Lu, L., Liu, J., Hwang, K., Hao, Y., Pan, Y., Meng, Q., Huang, K., Hu, L., Guizani, M., Chao, N., Fortino, G., Lin, F., Tian, Y., Niyato, D., & Wang, F. (2025). LLM Fine-Tuning: Concepts, Opportunities, and Challenges. Big Data and Cognitive Computing, 9(4), 87. https://doi.org/10.3390/bdcc9040087
Vancouver
Wu X, Chen M, Li W, Wang R, Lu L, Liu J, et al. LLM Fine-Tuning: Concepts, Opportunities, and Challenges. Big Data and Cognitive Computing. 2025;9(4):87. doi:10.3390/bdcc9040087
BibTeX
@article{Wu2025,
author = {Wu, Xiao-Kun and Chen, Min and Li, Wanyi and Wang, Rui and Lu, Limeng and Liu, Jia and Hwang, Kai and Hao, Yixue and Pan, Yanru and Meng, Qingguo and Huang, Kaibin and Hu, Long and Guizani, Mohsen and Chao, Naipeng and Fortino, Giancarlo and Lin, Fei and Tian, Yonglin and Niyato, Dusit and Wang, Fei-Yue},
title = {LLM Fine-Tuning: Concepts, Opportunities, and Challenges},
journal = {Big Data and Cognitive Computing},
year = {2025},
volume = {9},
number = {4},
pages = {87},
doi = {10.3390/bdcc9040087}
}
EUVIMED