Exploring Human Emotions: A Virtual Reality-Based Experimental Approach Integrating Physiological and Facial Analysis
Multimodal Technologies and Interaction · 04.06.2024 · 8 (6) · 47
DOI: 10.3390/mti8060047 ↗Kurz gefasst
Fachartikel in der Zeitschrift Multimodal Technologies and Interaction, online erschienen am 04.06.2024. Verfasst von Leire Bastida und 4 weiteren Autor:innen. Die Arbeit wurde bisher 11-mal zitiert (Crossref) und nennt 35 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: European Commission.
Abstract (Originalsprache)
This paper researches the classification of human emotions in a virtual reality (VR) context by analysing psychophysiological signals and facial expressions. Key objectives include exploring emotion categorisation models, identifying critical human signals for assessing emotions, and evaluating the accuracy of these signals in VR environments. A systematic literature review was performed through peer-reviewed articles, forming the basis for our methodologies. The integration of various emotion classifiers employs a ‘late fusion’ technique due to varying accuracies among classifiers. Notably, facial expression analysis faces challenges from VR equipment occluding crucial facial regions like the eyes, which significantly impacts emotion recognition accuracy. A weighted averaging system prioritises the psychophysiological classifier over the facial recognition classifiers due to its higher accuracy. Findings suggest that while combined techniques are promising, they struggle with mixed emotional states as well as with fear and trust emotions. The research underscores the potential and limitations of current technologies, recommending enhanced algorithms for effective interpretation of complex emotional expressions in VR. The study provides a groundwork for future advancements, aiming to refine emotion recognition systems through systematic data collection and algorithm optimisation.
Förderung
- European Commission
Zitieren
APA
Bastida, L., Sillaurren, S., Loizaga, E., Tomé, E., & Moya, A. (2024). Exploring Human Emotions: A Virtual Reality-Based Experimental Approach Integrating Physiological and Facial Analysis. Multimodal Technologies and Interaction, 8(6), 47. https://doi.org/10.3390/mti8060047
Vancouver
Bastida L, Sillaurren S, Loizaga E, Tomé E, Moya A. Exploring Human Emotions: A Virtual Reality-Based Experimental Approach Integrating Physiological and Facial Analysis. Multimodal Technologies and Interaction. 2024;8(6):47. doi:10.3390/mti8060047
BibTeX
@article{Bastida2024,
author = {Bastida, Leire and Sillaurren, Sara and Loizaga, Erlantz and Tomé, Eneko and Moya, Ana},
title = {Exploring Human Emotions: A Virtual Reality-Based Experimental Approach Integrating Physiological and Facial Analysis},
journal = {Multimodal Technologies and Interaction},
year = {2024},
volume = {8},
number = {6},
pages = {47},
doi = {10.3390/mti8060047}
}
EUVIMED