LMLPA: Language Model Linguistic Personality Assessment
Computational Linguistics · 24.06.2025 · 51 (2) · 599-640
DOI: 10.1162/coli_a_00550 ↗Kurz gefasst
Fachartikel in der Zeitschrift Computational Linguistics, online erschienen am 24.06.2025. Verfasst von Jingyao Zheng und 4 weiteren Autor:innen. Die Arbeit wurde bisher 6-mal zitiert (Crossref) und nennt 74 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0).
Abstract (Originalsprache)
Large language models (LLMs) are increasingly used in everyday life and research. One of the most common use cases is conversational interactions, enabled by the language generation capabilities of LLMs. Just as between two humans, a conversation between an LLM-powered entity and a human depends on the personality of the conversants. However, measuring the personality of a given LLM is currently a challenge. This article introduces the Language Model Linguistic Personality Assessment (LMLPA), a system designed to evaluate the linguistic personalities of LLMs. Our system helps to understand LLMs’ language generation capabilities by quantitatively assessing the distinct personality traits reflected in their linguistic outputs. Unlike traditional human-centric psychometrics, the LMLPA adapts a personality assessment questionnaire, specifically the Big Five Inventory, to align with the operational capabilities of LLMs, and also incorporates the findings from previous language-based personality measurement literature. To mitigate sensitivity to the order of options, our questionnaire is designed to be open-ended, resulting in textual answers. Thus, the Artificial Intelligence (AI) rater is needed to transform ambiguous personality information from text responses into clear numerical indicators of personality traits. Utilizing Principal Component Analysis and reliability validation methods, our findings demonstrate that LLMs possess distinct personality traits that can be effectively quantified by the LMLPA. This research contributes to Human-Centered AI and Computational Linguistics, providing a robust framework for future studies to refine AI personality assessments and expand their applications in multiple areas, including education and manufacturing.
Zitieren
APA
Zheng, J., Wang, X., Hosio, S., Xu, X., & Lee, L. (2025). LMLPA: Language Model Linguistic Personality Assessment. Computational Linguistics, 51(2), 599-640. https://doi.org/10.1162/coli_a_00550
Vancouver
Zheng J, Wang X, Hosio S, Xu X, Lee L. LMLPA: Language Model Linguistic Personality Assessment. Computational Linguistics. 2025;51(2):599-640. doi:10.1162/coli_a_00550
BibTeX
@article{Zheng2025,
author = {Zheng, Jingyao and Wang, Xian and Hosio, Simo and Xu, Xiaoxian and Lee, Lik-Hang},
title = {LMLPA: Language Model Linguistic Personality Assessment},
journal = {Computational Linguistics},
year = {2025},
volume = {51},
number = {2},
pages = {599--640},
doi = {10.1162/coli_a_00550}
}
EUVIMED