Spatial Attention-Guided Light Field Salient Object Detection Network With Implicit Neural Representation
IEEE Transactions on Circuits and Systems for Video Technology · 2024-12 · 34 (12) · 12437-12449
DOI: 10.1109/tcsvt.2024.3437685 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Circuits and Systems for Video Technology, 2024-12. Verfasst von Xin Zheng und 4 weiteren Autor:innen. Die Arbeit wurde bisher 38-mal zitiert (Crossref) und nennt 86 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Talent Introduction Program for Youth Innovation Teams of Shandong Province, University Science Research Project of Anhui Province in China.
Abstract (Originalsprache)
Recently, many Light Field Salient Object Detection (LF SOD) methods have been proposed. However, guaranteeing the integrality and recovering more high-frequency details of the generated salient object map still remain challenging. To this end, we propose a spatial attention-guided LF SOD network with implicit neural representation to further improve LF SOD performance. We adopt an encoder-decoder structure for model construction. In order to ensure the completeness of the generated salient object map, a multi-modal and multi-scale feature fusion module is designed in the encoder part to refine the salient regions within all-in-focus image and aggregate the focal stack and all-in-focus image in spatial attention-guided manner. In order to recover more high-frequency details of the obtained salient object map, an implicit detail restoration module is proposed in the decoder part. In virtue of implicit neural representation, we convert the detail restoration problem into a functional mapping problem. By further integrating the self-attention mechanism, the derived saliency map can be depicted at a more refined level. Comprehensive experimental results demonstrate the superiority of the proposed method. Ablation studies and visual comparisons further validate that the proposed method can guarantee the integrality and recover more high-frequency detail information of the obtained saliency map. The code is publicly available at https://github.com/ldyorchid/LFSOD-Net.
Förderung
- National Natural Science Foundation of China
- Talent Introduction Program for Youth Innovation Teams of Shandong Province
- University Science Research Project of Anhui Province in China
- Taishan Scholar Foundation of Shandong Province
Zitieren
APA
Zheng, X., Li, Z., Liu, D., Zhou, X., & Shan, C. (2024). Spatial Attention-Guided Light Field Salient Object Detection Network With Implicit Neural Representation. IEEE Transactions on Circuits and Systems for Video Technology, 34(12), 12437-12449. https://doi.org/10.1109/tcsvt.2024.3437685
Vancouver
Zheng X, Li Z, Liu D, Zhou X, Shan C. Spatial Attention-Guided Light Field Salient Object Detection Network With Implicit Neural Representation. IEEE Transactions on Circuits and Systems for Video Technology. 2024;34(12):12437-12449. doi:10.1109/tcsvt.2024.3437685
BibTeX
@article{Zheng2024,
author = {Zheng, Xin and Li, Zhengqu and Liu, Deyang and Zhou, Xiaofei and Shan, Caifeng},
title = {Spatial Attention-Guided Light Field Salient Object Detection Network With Implicit Neural Representation},
journal = {IEEE Transactions on Circuits and Systems for Video Technology},
year = {2024},
volume = {34},
number = {12},
pages = {12437--12449},
doi = {10.1109/tcsvt.2024.3437685}
}
EUVIMED