NESS-Net: An NAMLab Edge-Guided and Scribble-Supervised Swin-Transformer Net for RGB-D Salient Object Detection
IEEE Transactions on Circuits and Systems for Video Technology · 2026-07 · 36 (7) · 9987-10002
DOI: 10.1109/tcsvt.2026.3673067 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Circuits and Systems for Video Technology, 2026-07. Verfasst von Yunping Zheng und 4 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 72 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Natural Science Foundation of Guangdong Province of China.
Abstract (Originalsprache)
The advent of scribble-supervised learning has opened new frontiers in weakly supervised RGB-D salient object detection (SOD), representing a novel paradigm that significantly reduces annotation costs while maintaining detection efficacy. The SOD methods predominantly based on convolutional neural networks (CNNs) exhibit notable limitations in capturing global contextual dependencies and effectively utilizing hierarchical multiscale representations. Furthermore, conventional edge extraction approaches based on Canny edge detection demonstrate inherent limitations in preserving structural coherence across diverse object boundaries. To address these critical challenges, we propose an NESS-Net model, an innovative weakly supervised architecture that synergistically integrates our previously developed NAMLab framework with Swin-Transformer-based feature learning. The core contributions of our work are threefold: Firstly, building upon our prior work in perceptual-aware image segmentation, we employ the NAMLab algorithm—a hierarchical segmentation framework inspired by Nonsymmetry and Anti-packing pattern representation Model in the Lab color space (NAMLab)—to generate edge maps that better align with human visual perception. Secondly, we devise a U-shaped Edge Construction Module (ECM) that systematically refines edge features through progressive refinement of the NAMLab-generated edge priors. Thirdly, leveraging Swin-Transformer’s hierarchical attention mechanism, we put forward a lightweight Cross-Attention Fusion Module (CAFM) that establishes long-range dependencies across modalities while maintaining computational efficiency. This architectural innovation naturally extends to our Cross-Modal multi-scale Attention-weighting Module (CMAM), which explicitly models inter-modal relationships through transformer-based attention weighting. The extensive experimental results on nine benchmark RGB-D SOD datasets demonstrate that our proposed NESS-Net model outperforms all the current state-of-the-art scribble-supervised models and even achieves performance competitive to leading fully supervised models. The source code and pre-trained models will be made publicly available at https://github.com/EricLie-c/NESS-Net
Förderung
- National Natural Science Foundation of China
- Natural Science Foundation of Guangdong Province of China
Zitieren
APA
Zheng, Y., Li, H., Shu, S., Xu, K., & Sarem, M. (2026). NESS-Net: An NAMLab Edge-Guided and Scribble-Supervised Swin-Transformer Net for RGB-D Salient Object Detection. IEEE Transactions on Circuits and Systems for Video Technology, 36(7), 9987-10002. https://doi.org/10.1109/tcsvt.2026.3673067
Vancouver
Zheng Y, Li H, Shu S, Xu K, Sarem M. NESS-Net: An NAMLab Edge-Guided and Scribble-Supervised Swin-Transformer Net for RGB-D Salient Object Detection. IEEE Transactions on Circuits and Systems for Video Technology. 2026;36(7):9987-10002. doi:10.1109/tcsvt.2026.3673067
BibTeX
@article{Zheng2026,
author = {Zheng, Yunping and Li, Hao and Shu, Shiqiang and Xu, Ke and Sarem, Mudar},
title = {NESS-Net: An NAMLab Edge-Guided and Scribble-Supervised Swin-Transformer Net for RGB-D Salient Object Detection},
journal = {IEEE Transactions on Circuits and Systems for Video Technology},
year = {2026},
volume = {36},
number = {7},
pages = {9987--10002},
doi = {10.1109/tcsvt.2026.3673067}
}
EUVIMED