EUVIMEDEUVIMED entdecken
Crossref

Light Fields Stitching for Windowed-6DoF VR Content

Yihui Fan, Xin Jin, Siyao Zhou, Shun Zou

IEEE Transactions on Circuits and Systems for Video Technology · 2024-09 · 34 (9) · 8736-8752

DOI: 10.1109/tcsvt.2024.3391853 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Circuits and Systems for Video Technology, 2024-09. Verfasst von Yihui Fan und 3 weiteren Autor:innen. Die Arbeit wurde bisher 9-mal zitiert (Crossref) und nennt 40 Literaturangaben. Gefördert von: Shenzhen Science and Technology Project, NSFC, China.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Windowed six degrees of Freedom (Windowed-6DoF) virtual reality (VR) content that provides users an immersive feeling of walking through a 3D 360 VR space with constrained rotational movements around X and Y axes and constrained translational movements along Z axis is important for the development of VR. To facilitate this windowed-6DoF immersive feeling, light fields (LFs) from multiple perspectives within the windowed 6-DoF space are captured. In contrast to employing a large-scale camera array for LF capture, utilizing hand-held plenoptic cameras offers a more portable and versatile solution, thereby promoting practical applications. However, how to stitch the LFs at different rotational angles containing motion parallax is challenging. In this paper, a novel LF stitching method is proposed to generate windowed-6DoF LFs. First, multi-concentric spherical modeling is proposed to parameterize the recorded LFs to eliminate projection biases in the registration process. Then, a global-local adaptive LF registration is proposed by developing incremental multi-layer global-local adaptive homographies based on the 4D light field feature (LiFF), incremental strategy and depth layer maps (DLMs) to eliminate parallax errors. Testing on the LFs captured in both indoor and outdoor scenes with different focal lengths, quantities of LFs and scales of translation and rotation, the proposed method outperforms the existing approaches in terms of subjective quality, objective quality, light field consistency and content production robustness, which can produce VR content of superior quality more reliably.

Förderung

  • Shenzhen Science and Technology Project
  • NSFC, China

Zitieren

APA

Fan, Y., Jin, X., Zhou, S., & Zou, S. (2024). Light Fields Stitching for Windowed-6DoF VR Content. IEEE Transactions on Circuits and Systems for Video Technology, 34(9), 8736-8752. https://doi.org/10.1109/tcsvt.2024.3391853

Vancouver

Fan Y, Jin X, Zhou S, Zou S. Light Fields Stitching for Windowed-6DoF VR Content. IEEE Transactions on Circuits and Systems for Video Technology. 2024;34(9):8736-8752. doi:10.1109/tcsvt.2024.3391853

BibTeX
@article{Fan2024,
  author = {Fan, Yihui and Jin, Xin and Zhou, Siyao and Zou, Shun},
  title = {Light Fields Stitching for Windowed-6DoF VR Content},
  journal = {IEEE Transactions on Circuits and Systems for Video Technology},
  year = {2024},
  volume = {34},
  number = {9},
  pages = {8736--8752},
  doi = {10.1109/tcsvt.2024.3391853}
}
Kostenlos starten →