Robust Perception and Precise Segmentation for Scribble-Supervised RGB-D Saliency Detection
IEEE Transactions on Pattern Analysis and Machine Intelligence · 2024-01 · 46 (1) · 479-496
DOI: 10.1109/tpami.2023.3324807 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Pattern Analysis and Machine Intelligence, 2024-01. Verfasst von Long Li und 6 weiteren Autor:innen. Die Arbeit wurde bisher 52-mal zitiert (Crossref) und nennt 74 Literaturangaben. Gefördert von: National Key R&D Program of China, National Natural Science Foundation of China, Key R&D Program of Shaanxi Province.
Abstract (Originalsprache)
This paper proposes a scribble-based weakly supervised RGB-D salient object detection (SOD) method to relieve the annotation burden from pixel-wise annotations. In view of the ensuing performance drop, we summarize two natural deficiencies of the scribbles and try to alleviate them, which are the weak richness of the pixel training samples (WRPS) and the poor structural integrity of the salient objects (PSIO). WRPS hinders robust saliency perception learning, which can be alleviated via model design for robust feature learning and pseudo labels generation for training sample enrichment. Specifically, we first design a dynamic searching process module as a meta operation to conduct multi-scale and multi-modal feature fusion for the robust RGB-D SOD model construction. Then, a dual-branch consistency learning mechanism is proposed to generate enough pixel training samples for robust saliency perception learning. PSIO makes direct structural learning infeasible since scribbles can not provide integral structural supervision. Thus, we propose an edge-region structure-refinement loss to recover the structural information and make precise segmentation. We deploy all components and conduct ablation studies on two baselines to validate their effectiveness and generalizability. Experimental results on eight datasets show that our method outperforms other scribble-based SOD models and achieves comparable performance with fully supervised state-of-the-art methods.
Förderung
- National Key R&D Program of China
- National Natural Science Foundation of China
- Key R&D Program of Shaanxi Province
- MBZUAI-WIS Joint Program for AI Research
Zitieren
APA
Li, L., Han, J., Liu, N., Khan, S., Cholakkal, H., Anwer, R. M., & Khan, F. S. (2024). Robust Perception and Precise Segmentation for Scribble-Supervised RGB-D Saliency Detection. IEEE Transactions on Pattern Analysis and Machine Intelligence, 46(1), 479-496. https://doi.org/10.1109/tpami.2023.3324807
Vancouver
Li L, Han J, Liu N, Khan S, Cholakkal H, Anwer RM, et al. Robust Perception and Precise Segmentation for Scribble-Supervised RGB-D Saliency Detection. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2024;46(1):479-496. doi:10.1109/tpami.2023.3324807
BibTeX
@article{Li2024,
author = {Li, Long and Han, Junwei and Liu, Nian and Khan, Salman and Cholakkal, Hisham and Anwer, Rao Muhammad and Khan, Fahad Shahbaz},
title = {Robust Perception and Precise Segmentation for Scribble-Supervised RGB-D Saliency Detection},
journal = {IEEE Transactions on Pattern Analysis and Machine Intelligence},
year = {2024},
volume = {46},
number = {1},
pages = {479--496},
doi = {10.1109/tpami.2023.3324807}
}
EUVIMED