EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Exploring Human Emotions: A Virtual Reality-Based Experimental Approach Integrating Physiological and Facial Analysis

Leire Bastida, Sara Sillaurren, Erlantz Loizaga, Eneko Tomé, Ana Moya

Multimodal Technologies and Interaction · 04.06.2024 · 8 (6) · 47

DOI: 10.3390/mti8060047 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Multimodal Technologies and Interaction, online erschienen am 04.06.2024. Verfasst von Leire Bastida und 4 weiteren Autor:innen. Die Arbeit wurde bisher 11-mal zitiert (Crossref) und nennt 35 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: European Commission.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

This paper researches the classification of human emotions in a virtual reality (VR) context by analysing psychophysiological signals and facial expressions. Key objectives include exploring emotion categorisation models, identifying critical human signals for assessing emotions, and evaluating the accuracy of these signals in VR environments. A systematic literature review was performed through peer-reviewed articles, forming the basis for our methodologies. The integration of various emotion classifiers employs a ‘late fusion’ technique due to varying accuracies among classifiers. Notably, facial expression analysis faces challenges from VR equipment occluding crucial facial regions like the eyes, which significantly impacts emotion recognition accuracy. A weighted averaging system prioritises the psychophysiological classifier over the facial recognition classifiers due to its higher accuracy. Findings suggest that while combined techniques are promising, they struggle with mixed emotional states as well as with fear and trust emotions. The research underscores the potential and limitations of current technologies, recommending enhanced algorithms for effective interpretation of complex emotional expressions in VR. The study provides a groundwork for future advancements, aiming to refine emotion recognition systems through systematic data collection and algorithm optimisation.

Förderung

  • European Commission

Zitieren

APA

Bastida, L., Sillaurren, S., Loizaga, E., Tomé, E., & Moya, A. (2024). Exploring Human Emotions: A Virtual Reality-Based Experimental Approach Integrating Physiological and Facial Analysis. Multimodal Technologies and Interaction, 8(6), 47. https://doi.org/10.3390/mti8060047

Vancouver

Bastida L, Sillaurren S, Loizaga E, Tomé E, Moya A. Exploring Human Emotions: A Virtual Reality-Based Experimental Approach Integrating Physiological and Facial Analysis. Multimodal Technologies and Interaction. 2024;8(6):47. doi:10.3390/mti8060047

BibTeX
@article{Bastida2024,
  author = {Bastida, Leire and Sillaurren, Sara and Loizaga, Erlantz and Tomé, Eneko and Moya, Ana},
  title = {Exploring Human Emotions: A Virtual Reality-Based Experimental Approach Integrating Physiological and Facial Analysis},
  journal = {Multimodal Technologies and Interaction},
  year = {2024},
  volume = {8},
  number = {6},
  pages = {47},
  doi = {10.3390/mti8060047}
}
Kostenlos starten →