EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

MATER: M utually A ware Framework for T eleoperated-robot with E xtended R eality

Ziliang Zhang, Cong Liu, Hyoseung Kim

ACM SIGMETRICS Performance Evaluation Review · 20.07.2026 · 54 (1) · 132-134

DOI: 10.1145/3820171.3806876 ↗

Kurz gefasst

Fachartikel in der Zeitschrift ACM SIGMETRICS Performance Evaluation Review, online erschienen am 27.07.2026. Verfasst von Ziliang Zhang und 2 weiteren Autor:innen. Die Arbeit nennt 26 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: NSF (National Science Foundation).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Robot teleoperation with extended reality (XR teleoperation) enables intuitive interaction by mapping user motions to remote robots with real-time 3D feedback. However, existing systems suffer from large completion delays and trajectory deviations under prolonged network latency, rooted in their exclusive reliance on network communication and strict synchronous execution architecture. Moreover, network fluctuations destabilize teleoperation accuracy, while dynamic user motions amplify teleoperation errors. We present MATER, an end-to-end XR teleoperation framework that introduces a mutually-aware architecture in which each side reconstructs its counterpart's delayed or missing state to decouple the execution from network dependency. MATER includes latency-adaptive input window and user motion gap interpolation techniques to handle unstable network communication. It also proposes motion-driven robot state rollback and robot trajectory coordination to handle complex motions. The key idea behind these techniques is to adapt on the fly by reshaping reconstruction and filling gaps as network conditions fluctuate, and by realigning states when motions become fast or complex. Together with lightweight local synchronization and bandwidth optimizations, these system-level advances make MATER resilient to both network and motion dynamics. We implement MATER across three hardware settings, including simulated and physical robots, and evaluate it on 9,500 real-world teleoperation trials from the RoboSet dataset, covering single- and multi-step missions. Compared to state-of-the-art XR teleoperation frameworks, MATER reduces teleoperation error by up to 69.8% on WLAN and 73.1% on cellular networks with only 6.7% maximum runtime overhead. It also shortens mission completion time by up to 47.7%, enabling smoother teleoperation. A real-world case study on ten stationary and mobile missions further shows MATER achieves up to 37.7% faster completion while lowering average teleoperation error by up to 57.2%. MATER code is available at: https://github.com/rtenlab/mater

Förderung

  • NSF (National Science Foundation)

Zitieren

APA

Zhang, Z., Liu, C., & Kim, H. (2026). MATER: M utually A ware Framework for T eleoperated-robot with E xtended R eality. ACM SIGMETRICS Performance Evaluation Review, 54(1), 132-134. https://doi.org/10.1145/3820171.3806876

Vancouver

Zhang Z, Liu C, Kim H. MATER: M utually A ware Framework for T eleoperated-robot with E xtended R eality. ACM SIGMETRICS Performance Evaluation Review. 2026;54(1):132-134. doi:10.1145/3820171.3806876

BibTeX
@article{Zhang2026,
  author = {Zhang, Ziliang and Liu, Cong and Kim, Hyoseung},
  title = {MATER: M utually A ware Framework for T eleoperated-robot with E xtended R eality},
  journal = {ACM SIGMETRICS Performance Evaluation Review},
  year = {2026},
  volume = {54},
  number = {1},
  pages = {132--134},
  doi = {10.1145/3820171.3806876}
}
Kostenlos starten →