Light Fields Stitching for Windowed-6DoF VR Content
IEEE Transactions on Circuits and Systems for Video Technology · 2024-09 · 34 (9) · 8736-8752
DOI: 10.1109/tcsvt.2024.3391853 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Circuits and Systems for Video Technology, 2024-09. Verfasst von Yihui Fan und 3 weiteren Autor:innen. Die Arbeit wurde bisher 9-mal zitiert (Crossref) und nennt 40 Literaturangaben. Gefördert von: Shenzhen Science and Technology Project, NSFC, China.
Abstract (Originalsprache)
Windowed six degrees of Freedom (Windowed-6DoF) virtual reality (VR) content that provides users an immersive feeling of walking through a 3D 360 VR space with constrained rotational movements around X and Y axes and constrained translational movements along Z axis is important for the development of VR. To facilitate this windowed-6DoF immersive feeling, light fields (LFs) from multiple perspectives within the windowed 6-DoF space are captured. In contrast to employing a large-scale camera array for LF capture, utilizing hand-held plenoptic cameras offers a more portable and versatile solution, thereby promoting practical applications. However, how to stitch the LFs at different rotational angles containing motion parallax is challenging. In this paper, a novel LF stitching method is proposed to generate windowed-6DoF LFs. First, multi-concentric spherical modeling is proposed to parameterize the recorded LFs to eliminate projection biases in the registration process. Then, a global-local adaptive LF registration is proposed by developing incremental multi-layer global-local adaptive homographies based on the 4D light field feature (LiFF), incremental strategy and depth layer maps (DLMs) to eliminate parallax errors. Testing on the LFs captured in both indoor and outdoor scenes with different focal lengths, quantities of LFs and scales of translation and rotation, the proposed method outperforms the existing approaches in terms of subjective quality, objective quality, light field consistency and content production robustness, which can produce VR content of superior quality more reliably.
Förderung
- Shenzhen Science and Technology Project
- NSFC, China
Zitieren
APA
Fan, Y., Jin, X., Zhou, S., & Zou, S. (2024). Light Fields Stitching for Windowed-6DoF VR Content. IEEE Transactions on Circuits and Systems for Video Technology, 34(9), 8736-8752. https://doi.org/10.1109/tcsvt.2024.3391853
Vancouver
Fan Y, Jin X, Zhou S, Zou S. Light Fields Stitching for Windowed-6DoF VR Content. IEEE Transactions on Circuits and Systems for Video Technology. 2024;34(9):8736-8752. doi:10.1109/tcsvt.2024.3391853
BibTeX
@article{Fan2024,
author = {Fan, Yihui and Jin, Xin and Zhou, Siyao and Zou, Shun},
title = {Light Fields Stitching for Windowed-6DoF VR Content},
journal = {IEEE Transactions on Circuits and Systems for Video Technology},
year = {2024},
volume = {34},
number = {9},
pages = {8736--8752},
doi = {10.1109/tcsvt.2024.3391853}
}
EUVIMED