A Thorough Benchmark and a New Model for Light Field Saliency Detection
IEEE Transactions on Pattern Analysis and Machine Intelligence · 01.07.2023 · 45 (7) · 8003-8019
DOI: 10.1109/tpami.2023.3235415 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Pattern Analysis and Machine Intelligence, erschienen am 01.07.2023. Verfasst von Wei Gao und 3 weiteren Autor:innen. Die Arbeit wurde bisher 64-mal zitiert (Crossref) und nennt 80 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Basic and Applied Basic Research Foundation of Guangdong Province, Shenzhen Municipal Fundamental Research Program.
Abstract (Originalsprache)
Compared with current RGB or RGB-D saliency detection datasets, those for light field saliency detection often suffer from many defects, e.g., insufficient data amount and diversity, incomplete data formats, and rough annotations, thus impeding the prosperity of this field. To settle these issues, we elaborately build a large-scale light field dataset, dubbed PKU-LF, comprising 5,000 light fields and covering diverse indoor and outdoor scenes. Our PKU-LF provides all-inclusive representation formats of light fields and offers a unified platform for comparing algorithms utilizing different input formats. For sparking new vitality in saliency detection tasks, we present many unexplored scenarios (such as underwater and high-resolution scenes) and the richest annotations (such as scribble annotations, bounding boxes, object-/instance-level annotations, and edge annotations), on which many potential attention modeling tasks can be investigated. To facilitate the development of saliency detection, we systematically evaluate and analyze 16 representative 2D, 3D, and 4D methods on four existing datasets and the proposed dataset, furnishing a thorough benchmark. Furthermore, tailored to the distinct structural characteristics of light fields, a novel symmetric two-stream architecture (STSA) network is proposed to predict the saliency of light fields more accurately. Specifically, our STSA incorporates a focalness interweavement module (FIM) and three partial decoder modules (PDM). The former is designed to efficiently establish long-range dependencies across focal slices, while the latter aims to effectively aggregate the extracted coadjutant features in a mutual-enhancement way. Extensive experiments demonstrate that our method can significantly outperform the competitors.
Förderung
- National Natural Science Foundation of China
- Basic and Applied Basic Research Foundation of Guangdong Province
- Shenzhen Municipal Fundamental Research Program
- Shenzhen Science and Technology Plan Basic Research
- PCL
Zitieren
APA
Gao, W., Fan, S., Li, G., & Lin, W. (2023). A Thorough Benchmark and a New Model for Light Field Saliency Detection. IEEE Transactions on Pattern Analysis and Machine Intelligence, 45(7), 8003-8019. https://doi.org/10.1109/tpami.2023.3235415
Vancouver
Gao W, Fan S, Li G, Lin W. A Thorough Benchmark and a New Model for Light Field Saliency Detection. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2023;45(7):8003-8019. doi:10.1109/tpami.2023.3235415
BibTeX
@article{Gao2023,
author = {Gao, Wei and Fan, Songlin and Li, Ge and Lin, Weisi},
title = {A Thorough Benchmark and a New Model for Light Field Saliency Detection},
journal = {IEEE Transactions on Pattern Analysis and Machine Intelligence},
year = {2023},
volume = {45},
number = {7},
pages = {8003--8019},
doi = {10.1109/tpami.2023.3235415}
}
EUVIMED