EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC 4.0

Emotional intelligence of Large Language Models

Xuena Wang, Xueting Li, Zi Yin, Yue Wu, Jia Liu

Journal of Pacific Rim Psychology · 2023-01 · 17

DOI: 10.1177/18344909231213958 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Pacific Rim Psychology, online erschienen am 15.11.2023. Verfasst von Xuena Wang und 4 weiteren Autor:innen. Die Arbeit wurde bisher 134-mal zitiert (Crossref) und nennt 50 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0). Gefördert von: Tsinghua University Guoqiang Institute, Shuimu Tsinghua Scholar Program, Beijing Municipal Science & Technology Commission, Administrative Commission of Zhongguancun Science Park.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Large Language Models (LLMs) have demonstrated remarkable abilities across numerous disciplines, primarily assessed through tasks in language generation, knowledge utilization, and complex reasoning. However, their alignment with human emotions and values, which is critical for real-world applications, has not been systematically evaluated. Here, we assessed LLMs' Emotional Intelligence (EI), encompassing emotion recognition, interpretation, and understanding, which is necessary for effective communication and social interactions. Specifically, we first developed a novel psychometric assessment focusing on Emotion Understanding (EU), a core component of EI. This test is an objective, performance-driven, and text-based evaluation, which requires evaluating complex emotions in realistic scenarios, providing a consistent assessment for both human and LLM capabilities. With a reference frame constructed from over 500 adults, we tested a variety of mainstream LLMs. Most achieved above-average Emotional Quotient (EQ) scores, with GPT-4 exceeding 89% of human participants with an EQ of 117. Interestingly, a multivariate pattern analysis revealed that some LLMs apparently did not rely on the human-like mechanism to achieve human-level performance, as their representational patterns were qualitatively distinct from humans. In addition, we discussed the impact of factors such as model size, training method, and architecture on LLMs' EQ. In summary, our study presents one of the first psychometric evaluations of the human-like characteristics of LLMs, which may shed light on the future development of LLMs aiming for both high intellectual and emotional intelligence. Project website: https://emotional-intelligence.github.io/

Förderung

  • Tsinghua University Guoqiang Institute
  • Shuimu Tsinghua Scholar Program
  • Beijing Municipal Science & Technology Commission, Administrative Commission of Zhongguancun Science Park

Zitieren

APA

Wang, X., Li, X., Yin, Z., Wu, Y., & Liu, J. (2023). Emotional intelligence of Large Language Models. Journal of Pacific Rim Psychology, 17. https://doi.org/10.1177/18344909231213958

Vancouver

Wang X, Li X, Yin Z, Wu Y, Liu J. Emotional intelligence of Large Language Models. Journal of Pacific Rim Psychology. 2023;17. doi:10.1177/18344909231213958

BibTeX
@article{Wang2023,
  author = {Wang, Xuena and Li, Xueting and Yin, Zi and Wu, Yue and Liu, Jia},
  title = {Emotional intelligence of Large Language Models},
  journal = {Journal of Pacific Rim Psychology},
  year = {2023},
  volume = {17},
  doi = {10.1177/18344909231213958}
}
Kostenlos starten →