EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Implementation of Engagement Detection for Human–Robot Interaction in Complex Environments

Sin-Ru Lu, Jia-Hsun Lo iD, Yi-Tian Hong iD, Han-Pang Huang

Sensors · 2024

DOI: 10.3390/s24113311 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Sensors, 2024. Verfasst von Sin-Ru Lu und 3 weiteren Autor:innen. Beteiligte Einrichtung: Mechanical Engineering Department, National Taiwan University, Taipei 10617, Taiwan. Hauptthemen laut MEDLINE: Robotics. Die Arbeit wurde bisher 12-mal zitiert (Crossref) und nennt 41 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Science and Technology Council.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

This study develops a comprehensive robotic system, termed the robot cognitive system, for complex environments, integrating three models: the engagement model, the intention model, and the human–robot interaction (HRI) model. The system aims to enhance the naturalness and comfort of HRI by enabling robots to detect human behaviors, intentions, and emotions accurately. A novel dual-arm-hand mobile robot, Mobi, was designed to demonstrate the system’s efficacy. The engagement model utilizes eye gaze, head pose, and action recognition to determine the suitable moment for interaction initiation, addressing potential eye contact anxiety. The intention model employs sentiment analysis and emotion classification to infer the interactor’s intentions. The HRI model, integrated with Google Dialogflow, facilitates appropriate robot responses based on user feedback. The system’s performance was validated in a retail environment scenario, demonstrating its potential to improve the user experience in HRIs.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

RoboticsHumansEmotionsUser-Computer InterfaceMan-Machine Systems

Stichwörter der Autor:innen

action recognitioncognitive systemengagementhuman behaviorshuman–robot interaction

Autor:innen und Institutionen

  • Mechanical Engineering Department, National Taiwan University, Taipei 10617, Taiwan.

ORCID-Profile: Jia-Hsun Lo, Yi-Tian Hong

Förderung

  • National Science and Technology Council

Zitieren

APA

Lu, S. R., Lo, J. H., Hong, Y. T., & Huang, H. P. (2024). Implementation of Engagement Detection for Human–Robot Interaction in Complex Environments. Sensors. https://doi.org/10.3390/s24113311

Vancouver

Lu SR, Lo JH, Hong YT, Huang HP. Implementation of Engagement Detection for Human–Robot Interaction in Complex Environments. Sensors. 2024. doi:10.3390/s24113311

BibTeX
@article{Lu2024,
  author = {Lu, Sin-Ru and Lo, Jia-Hsun and Hong, Yi-Tian and Huang, Han-Pang},
  title = {Implementation of Engagement Detection for Human–Robot Interaction in Complex Environments},
  journal = {Sensors},
  year = {2024},
  doi = {10.3390/s24113311}
}
Kostenlos starten →