Semantic–Physical Sensor Fusion for Safe Physical Human–Robot Interaction in Dual-Arm Rehabilitation
Sensors · 2026
DOI: 10.3390/s26051510 ↗Kurz gefasst
Fachartikel in der Zeitschrift Sensors, 2026. Verfasst von Disha Zhu und 2 weiteren Autor:innen. Beteiligte Einrichtung: School of Nursing, Peking University, Beijing 100871, China. Hauptthemen laut MEDLINE: Robotics, Semantics, Arm, Rehabilitation. Die Arbeit wurde bisher 3-mal zitiert (Crossref) und nennt 55 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China.
Abstract (Originalsprache)
A safe physical human–robot interaction (pHRI) in rehabilitation requires reliable perception and low-latency decision making under heterogeneous and unreliable sensor inputs. This paper presents a multimodal sensor-fusion-based safety framework that integrates physical state estimation, semantic information fusion, and an edge-deployed large language model (LLM) for real-time pHRI safety control. A dynamics-based virtual sensing method is introduced to estimate internal joint torques from external force–torque measurements, achieving a normalized mean absolute error of 18.5% in real-world experiments. An asynchronous semantic state pool with a time-to-live mechanism is designed to fuse visual, force, posture, and human semantic cues while maintaining robustness to sensor delays and dropouts. Based on structured multimodal tokens, an instruction-tuned edge LLM outputs discrete safety decisions that are further mapped to continuous compliant control parameters. The framework is trained using a hybrid dataset consisting of limited real-world samples and LLM-augmented synthetic data, and evaluated on unseen real and mixed-condition scenarios. Experimental results show reliable detection of safety-critical events with a low emergency misdetection rate, while maintaining an end-to-end decision latency of approximately 223 ms on edge hardware. Real-world experiments on a rehabilitation robot demonstrate effective responses to impacts, user instability, and visual occlusions, indicating the practical applicability of the proposed approach for real-time pHRI safety monitoring.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- School of Nursing, Peking University, Beijing 100871, China.
- School of Advanced Manufacturing and Robotics, Peking University, Beijing 100871, China.
ORCID-Profile: Disha Zhu, Xuefeng Wang, Shaomei Shang
Förderung
- National Natural Science Foundation of China
Zitieren
APA
Zhu, D., Wang, X., & Shang, S. (2026). Semantic–Physical Sensor Fusion for Safe Physical Human–Robot Interaction in Dual-Arm Rehabilitation. Sensors. https://doi.org/10.3390/s26051510
Vancouver
Zhu D, Wang X, Shang S. Semantic–Physical Sensor Fusion for Safe Physical Human–Robot Interaction in Dual-Arm Rehabilitation. Sensors. 2026. doi:10.3390/s26051510
BibTeX
@article{Zhu2026,
author = {Zhu, Disha and Wang, Xuefeng and Shang, Shaomei},
title = {Semantic–Physical Sensor Fusion for Safe Physical Human–Robot Interaction in Dual-Arm Rehabilitation},
journal = {Sensors},
year = {2026},
doi = {10.3390/s26051510}
}
EUVIMED