EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Transformer-based human-motion forecasting coupled with safe reinforcement learning for telepresence robot co-navigation

Heba G Mohamed, Muhammad Nasir Khan, Fawad Naseer, Muhammad Tahir, Mohsin Jamil

Frontiers in Neurorobotics · 02.02.2026 · 19

DOI: 10.3389/fnbot.2025.1697518 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Frontiers in Neurorobotics, online erschienen am 02.02.2026. Verfasst von Heba G Mohamed und 4 weiteren Autor:innen. Beteiligte Einrichtung: Department of Electrical Engineering, College of Engineering, Princess Nourah Bint Abdulrahman University, Riyadh, Saudi Arabia. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 44 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Deanship of Scientific Research, Princess Nourah Bint Abdulrahman University.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Introduction

Telepresence robots (TPRs) must co-navigate with humans in constrained hospital environments, where safety depends on anticipating rather than merely reacting to human motion. Existing approaches rarely integrate short-horizon human-motion forecasting with safety-constrained control, which reduces robustness in dense corridors and ward bays. This study addresses this gap by evaluating an anticipatory, safety-aware co-navigation framework for TPRs.

Methods

We developed a modular framework that couples a lightweight transformer-based forecaster that predicts multi-agent trajectories under occlusion with a safe reinforcement learning (RL) controller. The forecaster produces short-term distributions over pedestrian states that are embedded into the RL policy state and cost as risk-aware occupancy features. Safety is enforced via constrained policy optimization augmented by a run-time control barrier function (CBF) shield that filters unsafe actions. We benchmarked the approach against a social-force or dynamic window approach (DWA), an attention-based crowd-RL policy, and model predictive control (MPC) with CBF. Experiments were conducted across two hospital-like benchmarks (a crowded corridor and a four-bed ward), totaling 2,400 episodes. Outcomes included task success, collision count, minimum human–robot clearance, near-miss events ( ≤ 0.3 m), time-to-goal, CBF violations, and ablations removing forecasting and the CBF shield.

Results

Relative to the best-performing baseline, the proposed method improved task success by 21.6% and reduced collisions by 47.3%. Median minimum human–robot clearance increased by 0.19 m, and near-miss events decreased by 38.5%. Time-to-goal was maintained within +2.7% of MPC+CBF while incurring zero CBF violations under the shield. Ablation studies showed that removing forecasting degraded success by 14.2%, whereas removing the CBF shield increased constraint breaches from 0% to 6.1% of steps.

Discussion

Anticipatory perception combined with Safe-RL yields substantially safer and more reliable telepresence co-navigation in human-dense clinical layouts without sacrificing efficiency. The framework is modular, enabling alternative forecasters and safety shields. Limitations include sensitivity to forecast drift during abrupt changes in crowd flow. Future work will explore on-device adaptation, shared-autonomy overlays to incorporate operator intent, and prospective evaluations in live hospital workflows.

Schlagwörter

Stichwörter der Autor:innen

anticipatory perceptioncontrol barrier functions (CBF)crowd-aware navigationhealthcare environmentshuman–robot co-navigationsafe reinforcement learningtelepresence robots (TPRs)transformer-based motion forecasting

Autor:innen und Institutionen

  • Department of Electrical Engineering, College of Engineering, Princess Nourah Bint Abdulrahman University, Riyadh, Saudi Arabia.
  • Department of Electrical Engineering, Government College University Lahore, Lahore, Pakistan.
  • Department of Computer Science and Software Engineering, Beaconhouse International College, Faisalabad, Pakistan.
  • School of Computer Science and Mathematics, Faculty of Engineering, Liverpool John Moores University, Liverpool, United Kingdom.
  • Department of Computer Software Engineering, Sir Syed University of Engineering and Technology, Karachi, Pakistan.
  • Department of Engineering, Brock University, St. Catharines, ON, Canada.

Förderung

  • Deanship of Scientific Research, Princess Nourah Bint Abdulrahman University

Zitieren

APA

Mohamed, H. G., Khan, M. N., Naseer, F., Tahir, M., & Jamil, M. (2026). Transformer-based human-motion forecasting coupled with safe reinforcement learning for telepresence robot co-navigation. Frontiers in Neurorobotics, 19. https://doi.org/10.3389/fnbot.2025.1697518

Vancouver

Mohamed HG, Khan MN, Naseer F, Tahir M, Jamil M. Transformer-based human-motion forecasting coupled with safe reinforcement learning for telepresence robot co-navigation. Frontiers in Neurorobotics. 2026;19. doi:10.3389/fnbot.2025.1697518

BibTeX
@article{Mohamed2026,
  author = {Mohamed, Heba G and Khan, Muhammad Nasir and Naseer, Fawad and Tahir, Muhammad and Jamil, Mohsin},
  title = {Transformer-based human-motion forecasting coupled with safe reinforcement learning for telepresence robot co-navigation},
  journal = {Frontiers in Neurorobotics},
  year = {2026},
  volume = {19},
  doi = {10.3389/fnbot.2025.1697518}
}
Kostenlos starten →