Disentangling Light Fields for Super-Resolution and Disparity Estimation
IEEE Transactions on Pattern Analysis and Machine Intelligence · 01.01.2023 · 45 (1) · 425-443
DOI: 10.1109/tpami.2022.3152488 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Pattern Analysis and Machine Intelligence, erschienen am 01.01.2023. Verfasst von Yingqian Wang und 6 weiteren Autor:innen. Die Arbeit wurde bisher 337-mal zitiert (Crossref) und nennt 83 Literaturangaben. Gefördert von: National Natural Science Foundation of China.
Abstract (Originalsprache)
Light field (LF) cameras record both intensity and directions of light rays, and encode 3D scenes into 4D LF images. Recently, many convolutional neural networks (CNNs) have been proposed for various LF image processing tasks. However, it is challenging for CNNs to effectively process LF images since the spatial and angular information are highly inter-twined with varying disparities. In this paper, we propose a generic mechanism to disentangle these coupled information for LF image processing. Specifically, we first design a class of domain-specific convolutions to disentangle LFs from different dimensions, and then leverage these disentangled features by designing task-specific modules. Our disentangling mechanism can well incorporate the LF structure prior and effectively handle 4D LF data. Based on the proposed mechanism, we develop three networks (i.e., DistgSSR, DistgASR and DistgDisp) for spatial super-resolution, angular super-resolution and disparity estimation. Experimental results show that our networks achieve state-of-the-art performance on all these three tasks, which demonstrates the effectiveness, efficiency, and generality of our disentangling mechanism. Project page: https://yingqianwang.github.io/DistgLF/.
Förderung
- National Natural Science Foundation of China
Zitieren
APA
Wang, Y., Wang, L., Wu, G., Yang, J., An, W., Yu, J., & Guo, Y. (2023). Disentangling Light Fields for Super-Resolution and Disparity Estimation. IEEE Transactions on Pattern Analysis and Machine Intelligence, 45(1), 425-443. https://doi.org/10.1109/tpami.2022.3152488
Vancouver
Wang Y, Wang L, Wu G, Yang J, An W, Yu J, et al. Disentangling Light Fields for Super-Resolution and Disparity Estimation. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2023;45(1):425-443. doi:10.1109/tpami.2022.3152488
BibTeX
@article{Wang2023,
author = {Wang, Yingqian and Wang, Longguang and Wu, Gaochang and Yang, Jungang and An, Wei and Yu, Jingyi and Guo, Yulan},
title = {Disentangling Light Fields for Super-Resolution and Disparity Estimation},
journal = {IEEE Transactions on Pattern Analysis and Machine Intelligence},
year = {2023},
volume = {45},
number = {1},
pages = {425--443},
doi = {10.1109/tpami.2022.3152488}
}
EUVIMED