AI-Driven Classification of Personality Items: A Study on Large Language Models
Paidéia (Ribeirão Preto) · 2026 · 36
DOI: 10.1590/1982-4327e3609 ↗Kurz gefasst
Fachartikel in der Zeitschrift Paidéia (Ribeirão Preto), 2026. Verfasst von Carlos Henrique Sancineto da Silva Nunes und 5 weiteren Autor:innen. Die Arbeit nennt 44 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Coordenação de Aperfeiçoamento de Pessoal de Nível Superior, National Council for Scientific and Technological Development.
Abstract (Originalsprache)
This study investigates the effectiveness of large language models (LLMs) in classifying items that evaluate the Big Five personality dimensions, focusing on performance variations across traits and comparing local and cloud-based models. Five Natural Language Processing (NLP) models were used to classify 385 personality items, employing three levels of detail in prompt design. The results indicate that larger generative models, such as ChatGPT-4o and Gemini 1.5 Pro, outperformed smaller models in terms of accuracy, both for the five personality factors and overall. However, the Llama 3.1 model, run locally, showed adequate results for judge-based analyses, offering a viable alternative for those prioritizing data privacy. The study highlights the potential of LLMs as complementary tools in the development of psychological assessment instruments.
Förderung
- Coordenação de Aperfeiçoamento de Pessoal de Nível Superior
- National Council for Scientific and Technological Development
Zitieren
APA
Nunes, C. H. S. D. S., Peres, A. J. D. S., Mose, L. D. B., Čolović, P., Primi, R., & Franco, V. R. (2026). AI-Driven Classification of Personality Items: A Study on Large Language Models. Paidéia (Ribeirão Preto), 36. https://doi.org/10.1590/1982-4327e3609
Vancouver
Nunes CHSDS, Peres AJDS, Mose LDB, Čolović P, Primi R, Franco VR. AI-Driven Classification of Personality Items: A Study on Large Language Models. Paidéia (Ribeirão Preto). 2026;36. doi:10.1590/1982-4327e3609
BibTeX
@article{Nunes2026,
author = {Nunes, Carlos Henrique Sancineto da Silva and Peres, Alexandre José de Souza and Mose, Leonardo de Barros and Čolović, Petar and Primi, Ricardo and Franco, Vithor Rosa},
title = {AI-Driven Classification of Personality Items: A Study on Large Language Models},
journal = {Paidéia (Ribeirão Preto)},
year = {2026},
volume = {36},
doi = {10.1590/1982-4327e3609}
}
EUVIMED