MATER: M utually A ware Framework for T eleoperated-robot with E xtended R eality
ACM SIGMETRICS Performance Evaluation Review · 20.07.2026 · 54 (1) · 132-134
DOI: 10.1145/3820171.3806876 ↗Kurz gefasst
Fachartikel in der Zeitschrift ACM SIGMETRICS Performance Evaluation Review, online erschienen am 27.07.2026. Verfasst von Ziliang Zhang und 2 weiteren Autor:innen. Die Arbeit nennt 26 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: NSF (National Science Foundation).
Abstract (Originalsprache)
Robot teleoperation with extended reality (XR teleoperation) enables intuitive interaction by mapping user motions to remote robots with real-time 3D feedback. However, existing systems suffer from large completion delays and trajectory deviations under prolonged network latency, rooted in their exclusive reliance on network communication and strict synchronous execution architecture. Moreover, network fluctuations destabilize teleoperation accuracy, while dynamic user motions amplify teleoperation errors. We present MATER, an end-to-end XR teleoperation framework that introduces a mutually-aware architecture in which each side reconstructs its counterpart's delayed or missing state to decouple the execution from network dependency. MATER includes latency-adaptive input window and user motion gap interpolation techniques to handle unstable network communication. It also proposes motion-driven robot state rollback and robot trajectory coordination to handle complex motions. The key idea behind these techniques is to adapt on the fly by reshaping reconstruction and filling gaps as network conditions fluctuate, and by realigning states when motions become fast or complex. Together with lightweight local synchronization and bandwidth optimizations, these system-level advances make MATER resilient to both network and motion dynamics. We implement MATER across three hardware settings, including simulated and physical robots, and evaluate it on 9,500 real-world teleoperation trials from the RoboSet dataset, covering single- and multi-step missions. Compared to state-of-the-art XR teleoperation frameworks, MATER reduces teleoperation error by up to 69.8% on WLAN and 73.1% on cellular networks with only 6.7% maximum runtime overhead. It also shortens mission completion time by up to 47.7%, enabling smoother teleoperation. A real-world case study on ten stationary and mobile missions further shows MATER achieves up to 37.7% faster completion while lowering average teleoperation error by up to 57.2%. MATER code is available at: https://github.com/rtenlab/mater
Förderung
- NSF (National Science Foundation)
Zitieren
APA
Zhang, Z., Liu, C., & Kim, H. (2026). MATER: M utually A ware Framework for T eleoperated-robot with E xtended R eality. ACM SIGMETRICS Performance Evaluation Review, 54(1), 132-134. https://doi.org/10.1145/3820171.3806876
Vancouver
Zhang Z, Liu C, Kim H. MATER: M utually A ware Framework for T eleoperated-robot with E xtended R eality. ACM SIGMETRICS Performance Evaluation Review. 2026;54(1):132-134. doi:10.1145/3820171.3806876
BibTeX
@article{Zhang2026,
author = {Zhang, Ziliang and Liu, Cong and Kim, Hyoseung},
title = {MATER: M utually A ware Framework for T eleoperated-robot with E xtended R eality},
journal = {ACM SIGMETRICS Performance Evaluation Review},
year = {2026},
volume = {54},
number = {1},
pages = {132--134},
doi = {10.1145/3820171.3806876}
}
EUVIMED