Cross-Modal Weakly Supervised RGB-D Salient Object Detection with a Focus on Filamentary Structures
Sensors · 09.05.2025 · 25 (10) · 2990
DOI: 10.3390/s25102990 ↗Kurz gefasst
Fachartikel in der Zeitschrift Sensors, online erschienen am 09.05.2025. Verfasst von Yifan Ding und 4 weiteren Autor:innen. Beteiligte Einrichtung: School of Electrical and Information Engineering, Wuhan Institute of Technology, Wuhan 430205, China. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 52 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China, Wuhan Municipal Natural Science Foundation.
Abstract (Originalsprache)
Current weakly supervised salient object detection (SOD) methods for RGB-D images mostly rely on image-level labels and sparse annotations, which makes it difficult to completely contour object boundaries in complex scenes, especially when detecting objects with filamentary structures. To address the aforementioned issues, we propose a novel cross-modal weakly supervised SOD framework. The framework can adequately exploit the advantages of cross-modal weak labels to generate high-quality pseudo-labels, and it can fully couple the multi-scale features of RGB and depth images for precise saliency prediction. The framework mainly consists of a cross-modal pseudo-label generation network (CPGN) and an asymmetric salient-region prediction network (ASPN). Among them, the CPGN is proposed to sufficiently leverage the precise pixel-level guidance provided by point labels and the enhanced semantic supervision provided by text labels to generate high-quality pseudo-labels, which are used to supervise the subsequent training of the ASPN. To better capture the contextual information and geometric features from RGB and depth images, the ASPN, an asymmetrically progressive network, is proposed to gradually extract multi-scale features from RGB and depth images by using the Swin-Transformer and CNN encoders, respectively. This significantly enhances the model’s ability to perceive detailed structures. Additionally, an edge constraint module (ECM) is designed to sharpen the edges of the predicted salient regions. The experimental results demonstrate that the method shows better performance in depicting salient objects, especially the filamentary structures, than other weakly supervised SOD methods.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- School of Electrical and Information Engineering, Wuhan Institute of Technology, Wuhan 430205, China.
ORCID-Profile: Yifan Ding, Weiwei Chen, Xuan Li
Förderung
- National Natural Science Foundation of China
- Wuhan Municipal Natural Science Foundation
Zitieren
APA
Ding, Y., Chen, W., Zhang, G., Feng, Z., & Li, X. (2025). Cross-Modal Weakly Supervised RGB-D Salient Object Detection with a Focus on Filamentary Structures. Sensors, 25(10), 2990. https://doi.org/10.3390/s25102990
Vancouver
Ding Y, Chen W, Zhang G, Feng Z, Li X. Cross-Modal Weakly Supervised RGB-D Salient Object Detection with a Focus on Filamentary Structures. Sensors. 2025;25(10):2990. doi:10.3390/s25102990
BibTeX
@article{Ding2025,
author = {Ding, Yifan and Chen, Weiwei and Zhang, Guomin and Feng, Zhaoming and Li, Xuan},
title = {Cross-Modal Weakly Supervised RGB-D Salient Object Detection with a Focus on Filamentary Structures},
journal = {Sensors},
year = {2025},
volume = {25},
number = {10},
pages = {2990},
doi = {10.3390/s25102990}
}
EUVIMED