EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Development and Validation of a Multimodal Emotion Recognition Ability Test Based on the Chinese Cultural Context

Xiaoming Song, Jinmei Leng, Xia Wu, Sheng Yang iD, Fang Luo

Journal of Intelligence · 01.08.2026 · 14 (8) · 169

DOI: 10.3390/jintelligence14080169 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Intelligence, online erschienen am 01.08.2026. Verfasst von Xiaoming Song und 4 weiteren Autor:innen. Beteiligte Einrichtung: Faculty of Psychology, Beijing Normal University, 19 Xinjiekouwai Street, Haidian District, Beijing 100875, China. Die Arbeit nennt 55 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Beijing Natural Science Foundation.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Emotion recognition is essential for social adaptation and mental health. However, existing measures still rely on limited stimulus materials or simplified task formats, which restricts ecological validity. The present study aimed to construct a localized multimodal emotion expression database in the Chinese context and to develop a multimodal emotion recognition ability test integrating emotion category and intensity recognition. In Study 1, a multimodal emotion expression database was established through actor performances, expert evaluation, and participant validation. The final database contained 2160 videos representing six basic emotions, five levels of emotional intensity, and two expression modes (vocal and non-vocal). In Study 2, 90 videos were selected under three recognition conditions (vocal-expression, muted vocal-expression, and muted non-vocal-expression). An integrated scoring approach combining emotion category and intensity was used to develop the test. A total of 236 valid participants completed the test. The results indicated that, after 61 video clips were retained, the test demonstrated good reliability and item discrimination. Evidence for criterion-related validity and construct validity was also obtained. Overall, the findings suggest that the present measure is a reliable and valid tool for assessing multimodal emotion recognition ability in the Chinese cultural context and offers the first empirical evidence that integrating category and intensity recognition can better capture the multidimensional nature of this ability.

Schlagwörter

Stichwörter der Autor:innen

category recognitionemotion recognition abilityintensity recognitionmultimodal databasetest development

Autor:innen und Institutionen

  • Faculty of Psychology, Beijing Normal University, 19 Xinjiekouwai Street, Haidian District, Beijing 100875, China.
  • School of Computer Science and Technology, Beijing Institute of Technology, Beijing 100081, China.
  • Li Auto Inc., 11 Wenliang Street, Shunyi District, Beijing 101399, China.

ORCID-Profile: Sheng Yang

Förderung

  • Beijing Natural Science Foundation

Zitieren

APA

Song, X., Leng, J., Wu, X., Yang, S., & Luo, F. (2026). Development and Validation of a Multimodal Emotion Recognition Ability Test Based on the Chinese Cultural Context. Journal of Intelligence, 14(8), 169. https://doi.org/10.3390/jintelligence14080169

Vancouver

Song X, Leng J, Wu X, Yang S, Luo F. Development and Validation of a Multimodal Emotion Recognition Ability Test Based on the Chinese Cultural Context. Journal of Intelligence. 2026;14(8):169. doi:10.3390/jintelligence14080169

BibTeX
@article{Song2026,
  author = {Song, Xiaoming and Leng, Jinmei and Wu, Xia and Yang, Sheng and Luo, Fang},
  title = {Development and Validation of a Multimodal Emotion Recognition Ability Test Based on the Chinese Cultural Context},
  journal = {Journal of Intelligence},
  year = {2026},
  volume = {14},
  number = {8},
  pages = {169},
  doi = {10.3390/jintelligence14080169}
}
Kostenlos starten →