EUVIMEDEUVIMED entdecken
Crossref

GHOST in the Robots: Real-Time Exocentric Dual-Robot VR Teleoperation From Onboard Cameras

Yichen Wei, Faisal Zaghloul, Soujanya C Aryal, Aanya K. Agrawal, Chengfan Li, Jason Xinyu Liu, James Tompkin, Stefanie Tellex

IEEE Robotics and Automation Letters · 2026-11 · 11 (11) · 12990-12997

DOI: 10.1109/lra.2026.3726328 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Robotics and Automation Letters, 2026-11. Verfasst von Yichen Wei und 7 weiteren Autor:innen. Die Arbeit nennt 53 Literaturangaben. Gefördert von: NASA, NSF.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Teleoperating multiple robots simultaneously enables additional views and coordinated control. Yet, it poses fundamental challenges: the system must present sensor data cohesively and allow operators to manage multiple robot bases, arms, and cameras while maintaining low latency. Current multi-robot teleoperation systems require multiple operators, rely on autonomy, or restrict operators to high-level commands. We present GHOST: an open-source VR teleoperation system that enables single-operator control of two mobile manipulators via direct low-level commands using only onboard sensing. GHOST creates an exocentric 3D workspace by aligning real-time point clouds from the robots' RGB-D cameras, where scene coverage is improved through learning-based completion to aid operator spatial awareness. For control, the operator uses a mode-switching architecture to command either robot individually or both robots simultaneously. Experiments with 15 novice participants demonstrate 1.6–4× the success rate of an off-the-shelf tablet interface. For experts across nine challenging dual-robot tasks, our system enabled completion of two tasks that were infeasible with the tablet, and was 1.47× faster on average than the tablet.

Förderung

  • NASA
  • NSF

Zitieren

APA

Wei, Y., Zaghloul, F., Aryal, S. C., Agrawal, A. K., Li, C., Liu, J. X., Tompkin, J., & Tellex, S. (2026). GHOST in the Robots: Real-Time Exocentric Dual-Robot VR Teleoperation From Onboard Cameras. IEEE Robotics and Automation Letters, 11(11), 12990-12997. https://doi.org/10.1109/lra.2026.3726328

Vancouver

Wei Y, Zaghloul F, Aryal SC, Agrawal AK, Li C, Liu JX, et al. GHOST in the Robots: Real-Time Exocentric Dual-Robot VR Teleoperation From Onboard Cameras. IEEE Robotics and Automation Letters. 2026;11(11):12990-12997. doi:10.1109/lra.2026.3726328

BibTeX
@article{Wei2026,
  author = {Wei, Yichen and Zaghloul, Faisal and Aryal, Soujanya C and Agrawal, Aanya K. and Li, Chengfan and Liu, Jason Xinyu and Tompkin, James and Tellex, Stefanie},
  title = {GHOST in the Robots: Real-Time Exocentric Dual-Robot VR Teleoperation From Onboard Cameras},
  journal = {IEEE Robotics and Automation Letters},
  year = {2026},
  volume = {11},
  number = {11},
  pages = {12990--12997},
  doi = {10.1109/lra.2026.3726328}
}
Kostenlos starten →