EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC-ND 4.0

Automatic Context-Aware Inference of Engagement in HMI: A Survey

Hanan Salam, Oya Celiktutan, Hatice Gunes, Mohamed Chetouani

IEEE Transactions on Affective Computing · 2024-04 · 15 (2) · 445-464

DOI: 10.1109/taffc.2023.3278707 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Affective Computing, 2024-04. Verfasst von Hanan Salam und 3 weiteren Autor:innen. Die Arbeit wurde bisher 36-mal zitiert (Crossref) und nennt 199 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0). Gefördert von: NYUAD Center for Artificial Intelligence and Robotics, Research Institute Centers, New York University Abu Dhabi, LISI - Learning to Imitate Nonverbal Communication Dynamics for Human-Robot Social Interaction.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Engagement is the process by which participants establish, maintain, and end their perceived connection. Automatic engagement inference is one of the tasks required to develop successful human-centered HMI applications. Engagement is a multi-faceted multimodal construct requiring high accuracy in interpretating contextual, verbal and non-verbal cues, making the development of an intelligent automated engagement inference system challenging. Existing surveys concentrate on specific application settings, and a comprehensive survey covering the different engagement facets, definition and inference across various contexts is lacking. Moreover, despite the importance of context-aware modeling, the literature lacks a systematic context-aware overview on the topic. This paper presents a comprehensive survey on previous work in engagement for HMI, entailing interdisciplinary definition, engagement components, publicly available datasets, ground truth assessment, and commonly used features and methods, serving as a guide for the development of future HMI interfaces with reliable context-aware engagement inference capability. An in-depth review across embodied and disembodied interaction modes, and an emphasis on the interaction context of which engagement is studied sets apart this survey from existing ones. Our findings suggest four important directions for future research: (1) context-aware computational modeling, (2) temporal dynamics, (3) personalised computing, and (4) bias and fairness of engagement inference systems.

Förderung

  • NYUAD Center for Artificial Intelligence and Robotics
  • Research Institute Centers, New York University Abu Dhabi
  • LISI - Learning to Imitate Nonverbal Communication Dynamics for Human-Robot Social Interaction
  • Engineering and Physical Sciences Research Council
  • EPSRC/UKRI
  • European Commission

Zitieren

APA

Salam, H., Celiktutan, O., Gunes, H., & Chetouani, M. (2024). Automatic Context-Aware Inference of Engagement in HMI: A Survey. IEEE Transactions on Affective Computing, 15(2), 445-464. https://doi.org/10.1109/taffc.2023.3278707

Vancouver

Salam H, Celiktutan O, Gunes H, Chetouani M. Automatic Context-Aware Inference of Engagement in HMI: A Survey. IEEE Transactions on Affective Computing. 2024;15(2):445-464. doi:10.1109/taffc.2023.3278707

BibTeX
@article{Salam2024,
  author = {Salam, Hanan and Celiktutan, Oya and Gunes, Hatice and Chetouani, Mohamed},
  title = {Automatic Context-Aware Inference of Engagement in HMI: A Survey},
  journal = {IEEE Transactions on Affective Computing},
  year = {2024},
  volume = {15},
  number = {2},
  pages = {445--464},
  doi = {10.1109/taffc.2023.3278707}
}
Kostenlos starten →