EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Exploring contactless techniques in multimodal emotion recognition: insights into diverse applications, challenges, solutions, and prospects

Umair Ali Khan, Qianru Xu, Yang Liu, Altti Lagstedt, Ari Alamäki, Janne Kauttonen

Multimedia Systems · 2024-06 · 30 (3)

DOI: 10.1007/s00530-024-01302-2 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Multimedia Systems, online erschienen am 06.04.2024. Verfasst von Umair Ali Khan und 5 weiteren Autor:innen. Die Arbeit wurde bisher 59-mal zitiert (Crossref) und nennt 320 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Opetus- ja Kulttuuriministeriö.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

In recent years, emotion recognition has received significant attention, presenting a plethora of opportunities for application in diverse fields such as human–computer interaction, psychology, and neuroscience, to name a few. Although unimodal emotion recognition methods offer certain benefits, they have limited ability to encompass the full spectrum of human emotional expression. In contrast, Multimodal Emotion Recognition (MER) delivers a more holistic and detailed insight into an individual's emotional state. However, existing multimodal data collection approaches utilizing contact-based devices hinder the effective deployment of this technology. We address this issue by examining the potential of contactless data collection techniques for MER. In our tertiary review study, we highlight the unaddressed gaps in the existing body of literature on MER. Through our rigorous analysis of MER studies, we identify the modalities, specific cues, open datasets with contactless cues, and unique modality combinations. This further leads us to the formulation of a comparative schema for mapping the MER requirements of a given scenario to a specific modality combination. Subsequently, we discuss the implementation of Contactless Multimodal Emotion Recognition (CMER) systems in diverse use cases with the help of the comparative schema which serves as an evaluation blueprint. Furthermore, this paper also explores ethical and privacy considerations concerning the employment of contactless MER and proposes the key principles for addressing ethical and privacy concerns. The paper further investigates the current challenges and future prospects in the field, offering recommendations for future research and development in CMER. Our study serves as a resource for researchers and practitioners in the field of emotion recognition, as well as those intrigued by the broader outcomes of this rapidly progressing technology.

Förderung

  • Opetus- ja Kulttuuriministeriö

Zitieren

APA

Khan, U. A., Xu, Q., Liu, Y., Lagstedt, A., Alamäki, A., & Kauttonen, J. (2024). Exploring contactless techniques in multimodal emotion recognition: insights into diverse applications, challenges, solutions, and prospects. Multimedia Systems, 30(3). https://doi.org/10.1007/s00530-024-01302-2

Vancouver

Khan UA, Xu Q, Liu Y, Lagstedt A, Alamäki A, Kauttonen J. Exploring contactless techniques in multimodal emotion recognition: insights into diverse applications, challenges, solutions, and prospects. Multimedia Systems. 2024;30(3). doi:10.1007/s00530-024-01302-2

BibTeX
@article{Khan2024,
  author = {Khan, Umair Ali and Xu, Qianru and Liu, Yang and Lagstedt, Altti and Alamäki, Ari and Kauttonen, Janne},
  title = {Exploring contactless techniques in multimodal emotion recognition: insights into diverse applications, challenges, solutions, and prospects},
  journal = {Multimedia Systems},
  year = {2024},
  volume = {30},
  number = {3},
  doi = {10.1007/s00530-024-01302-2}
}
Kostenlos starten →