EUVIMEDEUVIMED entdecken
Crossref

Disentangling Light Fields for Super-Resolution and Disparity Estimation

Yingqian Wang, Longguang Wang, Gaochang Wu, Jungang Yang, Wei An, Jingyi Yu, Yulan Guo

IEEE Transactions on Pattern Analysis and Machine Intelligence · 01.01.2023 · 45 (1) · 425-443

DOI: 10.1109/tpami.2022.3152488 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Pattern Analysis and Machine Intelligence, erschienen am 01.01.2023. Verfasst von Yingqian Wang und 6 weiteren Autor:innen. Die Arbeit wurde bisher 337-mal zitiert (Crossref) und nennt 83 Literaturangaben. Gefördert von: National Natural Science Foundation of China.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Light field (LF) cameras record both intensity and directions of light rays, and encode 3D scenes into 4D LF images. Recently, many convolutional neural networks (CNNs) have been proposed for various LF image processing tasks. However, it is challenging for CNNs to effectively process LF images since the spatial and angular information are highly inter-twined with varying disparities. In this paper, we propose a generic mechanism to disentangle these coupled information for LF image processing. Specifically, we first design a class of domain-specific convolutions to disentangle LFs from different dimensions, and then leverage these disentangled features by designing task-specific modules. Our disentangling mechanism can well incorporate the LF structure prior and effectively handle 4D LF data. Based on the proposed mechanism, we develop three networks (i.e., DistgSSR, DistgASR and DistgDisp) for spatial super-resolution, angular super-resolution and disparity estimation. Experimental results show that our networks achieve state-of-the-art performance on all these three tasks, which demonstrates the effectiveness, efficiency, and generality of our disentangling mechanism. Project page: https://yingqianwang.github.io/DistgLF/.

Förderung

  • National Natural Science Foundation of China

Zitieren

APA

Wang, Y., Wang, L., Wu, G., Yang, J., An, W., Yu, J., & Guo, Y. (2023). Disentangling Light Fields for Super-Resolution and Disparity Estimation. IEEE Transactions on Pattern Analysis and Machine Intelligence, 45(1), 425-443. https://doi.org/10.1109/tpami.2022.3152488

Vancouver

Wang Y, Wang L, Wu G, Yang J, An W, Yu J, et al. Disentangling Light Fields for Super-Resolution and Disparity Estimation. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2023;45(1):425-443. doi:10.1109/tpami.2022.3152488

BibTeX
@article{Wang2023,
  author = {Wang, Yingqian and Wang, Longguang and Wu, Gaochang and Yang, Jungang and An, Wei and Yu, Jingyi and Guo, Yulan},
  title = {Disentangling Light Fields for Super-Resolution and Disparity Estimation},
  journal = {IEEE Transactions on Pattern Analysis and Machine Intelligence},
  year = {2023},
  volume = {45},
  number = {1},
  pages = {425--443},
  doi = {10.1109/tpami.2022.3152488}
}
Kostenlos starten →