User Experience Evaluation in Non-Immersive 3D Digital Environments Using Facial Emotion Recognition
Journal on Interactive Systems · 30.05.2026 · 17 (1) · 547-566
DOI: 10.5753/jis.2026.7625 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal on Interactive Systems, online erschienen am 30.05.2026. Verfasst von Érico de Souza Veriscimo und 2 weiteren Autor:innen. Die Arbeit nennt 23 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
User experience (UX) is fundamental for the acceptance and use of information systems. Although there are well-known and widely used UX evaluation techniques for traditional interfaces, a literature review revealed several gaps regarding UX evaluation in non-immersive 3D interaction. One significant gap is the predominant use of pragmatic criteria in assessments, while another is the lack of an approach that evaluates hedonic aspects using facial emotion recognition. This work proposes an approach for automatically evaluating user experience in non-immersive three-dimensional environments, focusing on its hedonic aspects based on facial emotion recognition. An experimental protocol was developed and approved by the Ethics Committee. The experiment was conducted with 52 participants. Throughout the testing period (before, during, and after the interaction), participants' faces were recorded using a low-cost camera. The experiment involved participants playing a game and answering questionnaires, including categorization and mood profile instruments, as well as the UEQ-S and the PLEX Framework. The Face-api.js library was used for facial emotion recognition. The hypothesis that automatic facial emotion recognition can support user experience evaluation was confirmed. This method enabled the estimation of UEQ-S and PLEX questionnaire responses with an average error of approximately ±1 point using only emotion extraction through an artificial intelligence model. Given that UX evaluation is crucial for the acceptance of new software or functionality, this work contributes to improving system quality and acceptance.
Zitieren
APA
Veriscimo, É. D. S., Júnior, J. L. B., & Digiampietri, L. A. (2026). User Experience Evaluation in Non-Immersive 3D Digital Environments Using Facial Emotion Recognition. Journal on Interactive Systems, 17(1), 547-566. https://doi.org/10.5753/jis.2026.7625
Vancouver
Veriscimo ÉDS, Júnior JLB, Digiampietri LA. User Experience Evaluation in Non-Immersive 3D Digital Environments Using Facial Emotion Recognition. Journal on Interactive Systems. 2026;17(1):547-566. doi:10.5753/jis.2026.7625
BibTeX
@article{Veriscimo2026,
author = {Veriscimo, Érico de Souza and Júnior, João Luiz Bernardes and Digiampietri, Luciano Antonio},
title = {User Experience Evaluation in Non-Immersive 3D Digital Environments Using Facial Emotion Recognition},
journal = {Journal on Interactive Systems},
year = {2026},
volume = {17},
number = {1},
pages = {547--566},
doi = {10.5753/jis.2026.7625}
}
EUVIMED