EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC-ND 4.0

LMLPA: Language Model Linguistic Personality Assessment

Jingyao Zheng, Xian Wang, Simo Hosio, Xiaoxian Xu, Lik-Hang Lee

Computational Linguistics · 24.06.2025 · 51 (2) · 599-640

DOI: 10.1162/coli_a_00550 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Computational Linguistics, online erschienen am 24.06.2025. Verfasst von Jingyao Zheng und 4 weiteren Autor:innen. Die Arbeit wurde bisher 6-mal zitiert (Crossref) und nennt 74 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Large language models (LLMs) are increasingly used in everyday life and research. One of the most common use cases is conversational interactions, enabled by the language generation capabilities of LLMs. Just as between two humans, a conversation between an LLM-powered entity and a human depends on the personality of the conversants. However, measuring the personality of a given LLM is currently a challenge. This article introduces the Language Model Linguistic Personality Assessment (LMLPA), a system designed to evaluate the linguistic personalities of LLMs. Our system helps to understand LLMs’ language generation capabilities by quantitatively assessing the distinct personality traits reflected in their linguistic outputs. Unlike traditional human-centric psychometrics, the LMLPA adapts a personality assessment questionnaire, specifically the Big Five Inventory, to align with the operational capabilities of LLMs, and also incorporates the findings from previous language-based personality measurement literature. To mitigate sensitivity to the order of options, our questionnaire is designed to be open-ended, resulting in textual answers. Thus, the Artificial Intelligence (AI) rater is needed to transform ambiguous personality information from text responses into clear numerical indicators of personality traits. Utilizing Principal Component Analysis and reliability validation methods, our findings demonstrate that LLMs possess distinct personality traits that can be effectively quantified by the LMLPA. This research contributes to Human-Centered AI and Computational Linguistics, providing a robust framework for future studies to refine AI personality assessments and expand their applications in multiple areas, including education and manufacturing.

Zitieren

APA

Zheng, J., Wang, X., Hosio, S., Xu, X., & Lee, L. (2025). LMLPA: Language Model Linguistic Personality Assessment. Computational Linguistics, 51(2), 599-640. https://doi.org/10.1162/coli_a_00550

Vancouver

Zheng J, Wang X, Hosio S, Xu X, Lee L. LMLPA: Language Model Linguistic Personality Assessment. Computational Linguistics. 2025;51(2):599-640. doi:10.1162/coli_a_00550

BibTeX
@article{Zheng2025,
  author = {Zheng, Jingyao and Wang, Xian and Hosio, Simo and Xu, Xiaoxian and Lee, Lik-Hang},
  title = {LMLPA: Language Model Linguistic Personality Assessment},
  journal = {Computational Linguistics},
  year = {2025},
  volume = {51},
  number = {2},
  pages = {599--640},
  doi = {10.1162/coli_a_00550}
}
Kostenlos starten →