EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Safe physical interaction with cobots: a multi-modal fusion approach for health monitoring

Bo Guo, Huaming Liu, Lei Niu

Frontiers in Neurorobotics · 04.12.2023 · 17

DOI: 10.3389/fnbot.2023.1265936 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Frontiers in Neurorobotics, online erschienen am 04.12.2023. Verfasst von Bo Guo und 2 weiteren Autor:innen. Beteiligte Einrichtung: School of Computer and Information Engineering, Fuyang Normal University, Fuyang, China. Die Arbeit wurde bisher 9-mal zitiert (Crossref) und nennt 48 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Health monitoring is a critical aspect of personalized healthcare, enabling early detection, and intervention for various medical conditions. The emergence of cloud-based robot-assisted systems has opened new possibilities for efficient and remote health monitoring. In this paper, we present a Transformer-based Multi-modal Fusion approach for health monitoring, focusing on the effects of cognitive workload, assessment of cognitive workload in human-machine collaboration, and acceptability in human-machine interactions. Additionally, we investigate biomechanical strain measurement and evaluation, utilizing wearable devices to assess biomechanical risks in working environments. Furthermore, we study muscle fatigue assessment during collaborative tasks and propose methods for improving safe physical interaction with cobots. Our approach integrates multi-modal data, including visual, audio, and sensor- based inputs, enabling a holistic assessment of an individual's health status. The core of our method lies in leveraging the powerful Transformer model, known for its ability to capture complex relationships in sequential data. Through effective fusion and representation learning, our approach extracts meaningful features for accurate health monitoring. Experimental results on diverse datasets demonstrate the superiority of our Transformer-based multi- modal fusion approach, outperforming existing methods in capturing intricate patterns and predicting health conditions. The significance of our research lies in revolutionizing remote health monitoring, providing more accurate, and personalized healthcare services.

Schlagwörter

Stichwörter der Autor:innen

biomechanical straincognitive workloadhuman-machineinteraction cobotsmuscle fatigue

Autor:innen und Institutionen

  • School of Computer and Information Engineering, Fuyang Normal University, Fuyang, China.
  • Department of Computing, Faculty of Communication, Visual Art and Computing, Universiti Selangor, Selangor, Malaysia.

Zitieren

APA

Guo, B., Liu, H., & Niu, L. (2023). Safe physical interaction with cobots: a multi-modal fusion approach for health monitoring. Frontiers in Neurorobotics, 17. https://doi.org/10.3389/fnbot.2023.1265936

Vancouver

Guo B, Liu H, Niu L. Safe physical interaction with cobots: a multi-modal fusion approach for health monitoring. Frontiers in Neurorobotics. 2023;17. doi:10.3389/fnbot.2023.1265936

BibTeX
@article{Guo2023,
  author = {Guo, Bo and Liu, Huaming and Niu, Lei},
  title = {Safe physical interaction with cobots: a multi-modal fusion approach for health monitoring},
  journal = {Frontiers in Neurorobotics},
  year = {2023},
  volume = {17},
  doi = {10.3389/fnbot.2023.1265936}
}
Kostenlos starten →