A Survey on Human Preference Learning for Aligning Large Language Models
ACM Computing Surveys · 30.04.2026 · 58 (6) · 1-39
DOI: 10.1145/3773279 ↗Kurz gefasst
Fachartikel in der Zeitschrift ACM Computing Surveys, online erschienen am 06.12.2025. Verfasst von Ruili Jiang und 8 weiteren Autor:innen. Die Arbeit wurde bisher 12-mal zitiert (Crossref) und nennt 234 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Guangdong Basic and Applied Basic Research Foundation, Shenzhen Science and Technology Program.
Abstract (Originalsprache)
The recent surge in versatile large language models (LLMs) demonstrates remarkable success across a wide range of contexts. A key factor contributing to this success is LLM alignment, in which human preference learning plays a decisive role in steering the models’ capabilities toward fulfilling human objectives. In this survey, we review the progress in human preference learning within a unified framework, aiming to provide a comprehensive perspective on established methodologies while exploring avenues to further advance LLM alignment. Specifically, we categorize human preference feedback based on data sources and formats, summarize techniques for human preference modeling and usage, and present an overview of prevailing evaluation protocols for LLM alignment. Finally, we discuss the existing challenges and identify potential directions for future research, with a particular emphasis on generalizability, transferability, and controllability.
Förderung
- National Natural Science Foundation of China
- Guangdong Basic and Applied Basic Research Foundation
- Shenzhen Science and Technology Program
Zitieren
APA
Jiang, R., Chen, K., Bai, X., He, Z., Li, J., Yang, M., Zhao, T., Nie, L., & Zhang, M. (2026). A Survey on Human Preference Learning for Aligning Large Language Models. ACM Computing Surveys, 58(6), 1-39. https://doi.org/10.1145/3773279
Vancouver
Jiang R, Chen K, Bai X, He Z, Li J, Yang M, et al. A Survey on Human Preference Learning for Aligning Large Language Models. ACM Computing Surveys. 2026;58(6):1-39. doi:10.1145/3773279
BibTeX
@article{Jiang2026,
author = {Jiang, Ruili and Chen, Kehai and Bai, Xuefeng and He, Zhixuan and Li, Juntao and Yang, Muyun and Zhao, Tiejun and Nie, Liqiang and Zhang, Min},
title = {A Survey on Human Preference Learning for Aligning Large Language Models},
journal = {ACM Computing Surveys},
year = {2026},
volume = {58},
number = {6},
pages = {1--39},
doi = {10.1145/3773279}
}
EUVIMED