Viewpoint-Controllable Telepresence: A Robotic-Arm-Based Mixed-Reality Telecollaboration System
Sensors · 19.04.2023 · 23 (8) · 4113
DOI: 10.3390/s23084113 ↗Kurz gefasst
Fachartikel in der Zeitschrift Sensors, online erschienen am 19.04.2023. Verfasst von Le Luo und 4 weiteren Autor:innen. Beteiligte Einrichtung: Beijing Engineering Research Center of Mixed Reality and Advanced Display, Beijing Institute of Technology, Beijing 100081, China. Die Arbeit wurde bisher 16-mal zitiert (Crossref) und nennt 64 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China, the Beijing Municipal Science & Technology Commission and 605 Administrative Commission of Zhongguancun Science Park under Grant, the 111 Project.
Abstract (Originalsprache)
In mixed-reality (MR) telecollaboration, the local environment is remotely presented to a remote user wearing a virtual reality (VR) head-mounted display (HMD) via a video capture device. However, remote users frequently face challenges in naturally and actively manipulating their viewpoints. In this paper, we propose a telepresence system with viewpoint control, which involves a robotic arm equipped with a stereo camera in the local environment. This system enables remote users to actively and flexibly observe the local environment by moving their heads to manipulate the robotic arm. Additionally, to solve the problem of the limited field of view of the stereo camera and limited movement range of the robotic arm, we propose a 3D reconstruction method combined with a stereo video field-of-view enhancement technique to guide remote users to move within the movement range of the robotic arm and provide them with a larger range of local environment perception. Finally, a mixed-reality telecollaboration prototype was built, and two user studies were conducted to evaluate the overall system. User study A evaluated the interaction efficiency, system usability, workload, copresence, and user satisfaction of our system from the remote user’s perspective, and the results showed that our system can effectively improve the interaction efficiency while achieving a better user experience than two traditional view-sharing techniques based on 360 video and based on the local user’s first-person view. User study B evaluated our MR telecollaboration system prototype from both the remote-user side and the local-user side as a whole, providing directions and suggestions for the subsequent design and improvement of our mixed-reality telecollaboration system.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Beijing Engineering Research Center of Mixed Reality and Advanced Display, Beijing Institute of Technology, Beijing 100081, China.
ORCID-Profile: Le Luo, Dongdong Weng
Förderung
- National Natural Science Foundation of China
- the Beijing Municipal Science & Technology Commission and 605 Administrative Commission of Zhongguancun Science Park under Grant
- the 111 Project
- Beijing Municipal Science & Technology Commission
- 111 Project
Zitieren
APA
Luo, L., Weng, D., Hao, J., Tu, Z., & Jiang, H. (2023). Viewpoint-Controllable Telepresence: A Robotic-Arm-Based Mixed-Reality Telecollaboration System. Sensors, 23(8), 4113. https://doi.org/10.3390/s23084113
Vancouver
Luo L, Weng D, Hao J, Tu Z, Jiang H. Viewpoint-Controllable Telepresence: A Robotic-Arm-Based Mixed-Reality Telecollaboration System. Sensors. 2023;23(8):4113. doi:10.3390/s23084113
BibTeX
@article{Luo2023,
author = {Luo, Le and Weng, Dongdong and Hao, Jie and Tu, Ziqi and Jiang, Haiyan},
title = {Viewpoint-Controllable Telepresence: A Robotic-Arm-Based Mixed-Reality Telecollaboration System},
journal = {Sensors},
year = {2023},
volume = {23},
number = {8},
pages = {4113},
doi = {10.3390/s23084113}
}
EUVIMED