Transformer-based human-motion forecasting coupled with safe reinforcement learning for telepresence robot co-navigation
Frontiers in Neurorobotics · 02.02.2026 · 19
DOI: 10.3389/fnbot.2025.1697518 ↗Kurz gefasst
Fachartikel in der Zeitschrift Frontiers in Neurorobotics, online erschienen am 02.02.2026. Verfasst von Heba G Mohamed und 4 weiteren Autor:innen. Beteiligte Einrichtung: Department of Electrical Engineering, College of Engineering, Princess Nourah Bint Abdulrahman University, Riyadh, Saudi Arabia. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 44 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Deanship of Scientific Research, Princess Nourah Bint Abdulrahman University.
Abstract (Originalsprache)
Introduction
Telepresence robots (TPRs) must co-navigate with humans in constrained hospital environments, where safety depends on anticipating rather than merely reacting to human motion. Existing approaches rarely integrate short-horizon human-motion forecasting with safety-constrained control, which reduces robustness in dense corridors and ward bays. This study addresses this gap by evaluating an anticipatory, safety-aware co-navigation framework for TPRs.
Methods
We developed a modular framework that couples a lightweight transformer-based forecaster that predicts multi-agent trajectories under occlusion with a safe reinforcement learning (RL) controller. The forecaster produces short-term distributions over pedestrian states that are embedded into the RL policy state and cost as risk-aware occupancy features. Safety is enforced via constrained policy optimization augmented by a run-time control barrier function (CBF) shield that filters unsafe actions. We benchmarked the approach against a social-force or dynamic window approach (DWA), an attention-based crowd-RL policy, and model predictive control (MPC) with CBF. Experiments were conducted across two hospital-like benchmarks (a crowded corridor and a four-bed ward), totaling 2,400 episodes. Outcomes included task success, collision count, minimum human–robot clearance, near-miss events ( ≤ 0.3 m), time-to-goal, CBF violations, and ablations removing forecasting and the CBF shield.
Results
Relative to the best-performing baseline, the proposed method improved task success by 21.6% and reduced collisions by 47.3%. Median minimum human–robot clearance increased by 0.19 m, and near-miss events decreased by 38.5%. Time-to-goal was maintained within +2.7% of MPC+CBF while incurring zero CBF violations under the shield. Ablation studies showed that removing forecasting degraded success by 14.2%, whereas removing the CBF shield increased constraint breaches from 0% to 6.1% of steps.
Discussion
Anticipatory perception combined with Safe-RL yields substantially safer and more reliable telepresence co-navigation in human-dense clinical layouts without sacrificing efficiency. The framework is modular, enabling alternative forecasters and safety shields. Limitations include sensitivity to forecast drift during abrupt changes in crowd flow. Future work will explore on-device adaptation, shared-autonomy overlays to incorporate operator intent, and prospective evaluations in live hospital workflows.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Electrical Engineering, College of Engineering, Princess Nourah Bint Abdulrahman University, Riyadh, Saudi Arabia.
- Department of Electrical Engineering, Government College University Lahore, Lahore, Pakistan.
- Department of Computer Science and Software Engineering, Beaconhouse International College, Faisalabad, Pakistan.
- School of Computer Science and Mathematics, Faculty of Engineering, Liverpool John Moores University, Liverpool, United Kingdom.
- Department of Computer Software Engineering, Sir Syed University of Engineering and Technology, Karachi, Pakistan.
- Department of Engineering, Brock University, St. Catharines, ON, Canada.
Förderung
- Deanship of Scientific Research, Princess Nourah Bint Abdulrahman University
Zitieren
APA
Mohamed, H. G., Khan, M. N., Naseer, F., Tahir, M., & Jamil, M. (2026). Transformer-based human-motion forecasting coupled with safe reinforcement learning for telepresence robot co-navigation. Frontiers in Neurorobotics, 19. https://doi.org/10.3389/fnbot.2025.1697518
Vancouver
Mohamed HG, Khan MN, Naseer F, Tahir M, Jamil M. Transformer-based human-motion forecasting coupled with safe reinforcement learning for telepresence robot co-navigation. Frontiers in Neurorobotics. 2026;19. doi:10.3389/fnbot.2025.1697518
BibTeX
@article{Mohamed2026,
author = {Mohamed, Heba G and Khan, Muhammad Nasir and Naseer, Fawad and Tahir, Muhammad and Jamil, Mohsin},
title = {Transformer-based human-motion forecasting coupled with safe reinforcement learning for telepresence robot co-navigation},
journal = {Frontiers in Neurorobotics},
year = {2026},
volume = {19},
doi = {10.3389/fnbot.2025.1697518}
}
EUVIMED