EUVIMEDEUVIMED entdecken
Crossref

Robust Perception and Precise Segmentation for Scribble-Supervised RGB-D Saliency Detection

Long Li, Junwei Han, Nian Liu, Salman Khan, Hisham Cholakkal, Rao Muhammad Anwer, Fahad Shahbaz Khan

IEEE Transactions on Pattern Analysis and Machine Intelligence · 2024-01 · 46 (1) · 479-496

DOI: 10.1109/tpami.2023.3324807 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Pattern Analysis and Machine Intelligence, 2024-01. Verfasst von Long Li und 6 weiteren Autor:innen. Die Arbeit wurde bisher 52-mal zitiert (Crossref) und nennt 74 Literaturangaben. Gefördert von: National Key R&D Program of China, National Natural Science Foundation of China, Key R&D Program of Shaanxi Province.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

This paper proposes a scribble-based weakly supervised RGB-D salient object detection (SOD) method to relieve the annotation burden from pixel-wise annotations. In view of the ensuing performance drop, we summarize two natural deficiencies of the scribbles and try to alleviate them, which are the weak richness of the pixel training samples (WRPS) and the poor structural integrity of the salient objects (PSIO). WRPS hinders robust saliency perception learning, which can be alleviated via model design for robust feature learning and pseudo labels generation for training sample enrichment. Specifically, we first design a dynamic searching process module as a meta operation to conduct multi-scale and multi-modal feature fusion for the robust RGB-D SOD model construction. Then, a dual-branch consistency learning mechanism is proposed to generate enough pixel training samples for robust saliency perception learning. PSIO makes direct structural learning infeasible since scribbles can not provide integral structural supervision. Thus, we propose an edge-region structure-refinement loss to recover the structural information and make precise segmentation. We deploy all components and conduct ablation studies on two baselines to validate their effectiveness and generalizability. Experimental results on eight datasets show that our method outperforms other scribble-based SOD models and achieves comparable performance with fully supervised state-of-the-art methods.

Förderung

  • National Key R&D Program of China
  • National Natural Science Foundation of China
  • Key R&D Program of Shaanxi Province
  • MBZUAI-WIS Joint Program for AI Research

Zitieren

APA

Li, L., Han, J., Liu, N., Khan, S., Cholakkal, H., Anwer, R. M., & Khan, F. S. (2024). Robust Perception and Precise Segmentation for Scribble-Supervised RGB-D Saliency Detection. IEEE Transactions on Pattern Analysis and Machine Intelligence, 46(1), 479-496. https://doi.org/10.1109/tpami.2023.3324807

Vancouver

Li L, Han J, Liu N, Khan S, Cholakkal H, Anwer RM, et al. Robust Perception and Precise Segmentation for Scribble-Supervised RGB-D Saliency Detection. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2024;46(1):479-496. doi:10.1109/tpami.2023.3324807

BibTeX
@article{Li2024,
  author = {Li, Long and Han, Junwei and Liu, Nian and Khan, Salman and Cholakkal, Hisham and Anwer, Rao Muhammad and Khan, Fahad Shahbaz},
  title = {Robust Perception and Precise Segmentation for Scribble-Supervised RGB-D Saliency Detection},
  journal = {IEEE Transactions on Pattern Analysis and Machine Intelligence},
  year = {2024},
  volume = {46},
  number = {1},
  pages = {479--496},
  doi = {10.1109/tpami.2023.3324807}
}
Kostenlos starten →