EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Integration of Tracking, Re-Identification, and Gesture Recognition for Facilitating Human–Robot Interaction

Sukhan Lee, Soojin Lee, Hyunwoo Park

Sensors · 25.07.2024 · 24 (15) · 4850

DOI: 10.3390/s24154850 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Sensors, online erschienen am 25.07.2024. Verfasst von Sukhan Lee und 2 weiteren Autor:innen. Beteiligte Einrichtung: Department of Artificial Intelligence, Sungkyunkwan University, Suwon 16419, Republic of Korea. Hauptthemen laut MEDLINE: Robotics, Gestures. Die Arbeit wurde bisher 7-mal zitiert (Crossref) und nennt 47 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Ministry of Science and ICT, Korea Evaluation Institute of Industrial Technology, “Intelligent Manufacturing Solution under Edge-Brain Framework” Project of the Institute for Information and Communications Technology Promotion (IITP).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

For successful human–robot collaboration, it is crucial to establish and sustain quality interaction between humans and robots, making it essential to facilitate human–robot interaction (HRI) effectively. The evolution of robot intelligence now enables robots to take a proactive role in initiating and sustaining HRI, thereby allowing humans to concentrate more on their primary tasks. In this paper, we introduce a system known as the Robot-Facilitated Interaction System (RFIS), where mobile robots are employed to perform identification, tracking, re-identification, and gesture recognition in an integrated framework to ensure anytime readiness for HRI. We implemented the RFIS on an autonomous mobile robot used for transporting a patient, to demonstrate proactive, real-time, and user-friendly interaction with a caretaker involved in monitoring and nursing the patient. In the implementation, we focused on the efficient and robust integration of various interaction facilitation modules within a real-time HRI system that operates in an edge computing environment. Experimental results show that the RFIS, as a comprehensive system integrating caretaker recognition, tracking, re-identification, and gesture recognition, can provide an overall high quality of interaction in HRI facilitation with average accuracies exceeding 90% during real-time operations at 5 FPS.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

RoboticsGesturesHumansPattern Recognition, AutomatedAlgorithmsArtificial Intelligence

Stichwörter der Autor:innen

gesture recognitionhuman–robot interactionperson recognitionperson trackingre-identification

Autor:innen und Institutionen

  • Department of Artificial Intelligence, Sungkyunkwan University, Suwon 16419, Republic of Korea.
  • Department of Electrical and Computer Engineering, Sungkyunkwan University, Suwon 16419, Republic of Korea.

Förderung

  • Ministry of Science and ICT
  • Korea Evaluation Institute of Industrial Technology
  • “Intelligent Manufacturing Solution under Edge-Brain Framework” Project of the Institute for Information and Communications Technology Promotion (IITP)
  • AI Graduate School Program
  • ICT Consilience Program
  • Robocarechair: A Smart Transformable Robot for Multi-Functional Assistive Personal Care

Zitieren

APA

Lee, S., Lee, S., & Park, H. (2024). Integration of Tracking, Re-Identification, and Gesture Recognition for Facilitating Human–Robot Interaction. Sensors, 24(15), 4850. https://doi.org/10.3390/s24154850

Vancouver

Lee S, Lee S, Park H. Integration of Tracking, Re-Identification, and Gesture Recognition for Facilitating Human–Robot Interaction. Sensors. 2024;24(15):4850. doi:10.3390/s24154850

BibTeX
@article{Lee2024,
  author = {Lee, Sukhan and Lee, Soojin and Park, Hyunwoo},
  title = {Integration of Tracking, Re-Identification, and Gesture Recognition for Facilitating Human–Robot Interaction},
  journal = {Sensors},
  year = {2024},
  volume = {24},
  number = {15},
  pages = {4850},
  doi = {10.3390/s24154850}
}
Kostenlos starten →