EUVIMEDEUVIMED entdecken
Crossref

A Thorough Benchmark and a New Model for Light Field Saliency Detection

Wei Gao, Songlin Fan, Ge Li, Weisi Lin

IEEE Transactions on Pattern Analysis and Machine Intelligence · 01.07.2023 · 45 (7) · 8003-8019

DOI: 10.1109/tpami.2023.3235415 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Pattern Analysis and Machine Intelligence, erschienen am 01.07.2023. Verfasst von Wei Gao und 3 weiteren Autor:innen. Die Arbeit wurde bisher 64-mal zitiert (Crossref) und nennt 80 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Basic and Applied Basic Research Foundation of Guangdong Province, Shenzhen Municipal Fundamental Research Program.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Compared with current RGB or RGB-D saliency detection datasets, those for light field saliency detection often suffer from many defects, e.g., insufficient data amount and diversity, incomplete data formats, and rough annotations, thus impeding the prosperity of this field. To settle these issues, we elaborately build a large-scale light field dataset, dubbed PKU-LF, comprising 5,000 light fields and covering diverse indoor and outdoor scenes. Our PKU-LF provides all-inclusive representation formats of light fields and offers a unified platform for comparing algorithms utilizing different input formats. For sparking new vitality in saliency detection tasks, we present many unexplored scenarios (such as underwater and high-resolution scenes) and the richest annotations (such as scribble annotations, bounding boxes, object-/instance-level annotations, and edge annotations), on which many potential attention modeling tasks can be investigated. To facilitate the development of saliency detection, we systematically evaluate and analyze 16 representative 2D, 3D, and 4D methods on four existing datasets and the proposed dataset, furnishing a thorough benchmark. Furthermore, tailored to the distinct structural characteristics of light fields, a novel symmetric two-stream architecture (STSA) network is proposed to predict the saliency of light fields more accurately. Specifically, our STSA incorporates a focalness interweavement module (FIM) and three partial decoder modules (PDM). The former is designed to efficiently establish long-range dependencies across focal slices, while the latter aims to effectively aggregate the extracted coadjutant features in a mutual-enhancement way. Extensive experiments demonstrate that our method can significantly outperform the competitors.

Förderung

  • National Natural Science Foundation of China
  • Basic and Applied Basic Research Foundation of Guangdong Province
  • Shenzhen Municipal Fundamental Research Program
  • Shenzhen Science and Technology Plan Basic Research
  • PCL

Zitieren

APA

Gao, W., Fan, S., Li, G., & Lin, W. (2023). A Thorough Benchmark and a New Model for Light Field Saliency Detection. IEEE Transactions on Pattern Analysis and Machine Intelligence, 45(7), 8003-8019. https://doi.org/10.1109/tpami.2023.3235415

Vancouver

Gao W, Fan S, Li G, Lin W. A Thorough Benchmark and a New Model for Light Field Saliency Detection. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2023;45(7):8003-8019. doi:10.1109/tpami.2023.3235415

BibTeX
@article{Gao2023,
  author = {Gao, Wei and Fan, Songlin and Li, Ge and Lin, Weisi},
  title = {A Thorough Benchmark and a New Model for Light Field Saliency Detection},
  journal = {IEEE Transactions on Pattern Analysis and Machine Intelligence},
  year = {2023},
  volume = {45},
  number = {7},
  pages = {8003--8019},
  doi = {10.1109/tpami.2023.3235415}
}
Kostenlos starten →