EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Cross-Modal Weakly Supervised RGB-D Salient Object Detection with a Focus on Filamentary Structures

Yifan Ding iD, Weiwei Chen iD, Guomin Zhang, Zhaoming Feng, Xuan Li iD

Sensors · 09.05.2025 · 25 (10) · 2990

DOI: 10.3390/s25102990 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Sensors, online erschienen am 09.05.2025. Verfasst von Yifan Ding und 4 weiteren Autor:innen. Beteiligte Einrichtung: School of Electrical and Information Engineering, Wuhan Institute of Technology, Wuhan 430205, China. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 52 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China, Wuhan Municipal Natural Science Foundation.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Current weakly supervised salient object detection (SOD) methods for RGB-D images mostly rely on image-level labels and sparse annotations, which makes it difficult to completely contour object boundaries in complex scenes, especially when detecting objects with filamentary structures. To address the aforementioned issues, we propose a novel cross-modal weakly supervised SOD framework. The framework can adequately exploit the advantages of cross-modal weak labels to generate high-quality pseudo-labels, and it can fully couple the multi-scale features of RGB and depth images for precise saliency prediction. The framework mainly consists of a cross-modal pseudo-label generation network (CPGN) and an asymmetric salient-region prediction network (ASPN). Among them, the CPGN is proposed to sufficiently leverage the precise pixel-level guidance provided by point labels and the enhanced semantic supervision provided by text labels to generate high-quality pseudo-labels, which are used to supervise the subsequent training of the ASPN. To better capture the contextual information and geometric features from RGB and depth images, the ASPN, an asymmetrically progressive network, is proposed to gradually extract multi-scale features from RGB and depth images by using the Swin-Transformer and CNN encoders, respectively. This significantly enhances the model’s ability to perceive detailed structures. Additionally, an edge constraint module (ECM) is designed to sharpen the edges of the predicted salient regions. The experimental results demonstrate that the method shows better performance in depicting salient objects, especially the filamentary structures, than other weakly supervised SOD methods.

Schlagwörter

Stichwörter der Autor:innen

RGB-Dmulti-source annotationssaliency object detection (SOD)weak supervision

Autor:innen und Institutionen

  • School of Electrical and Information Engineering, Wuhan Institute of Technology, Wuhan 430205, China.

ORCID-Profile: Yifan Ding, Weiwei Chen, Xuan Li

Förderung

  • National Natural Science Foundation of China
  • Wuhan Municipal Natural Science Foundation

Zitieren

APA

Ding, Y., Chen, W., Zhang, G., Feng, Z., & Li, X. (2025). Cross-Modal Weakly Supervised RGB-D Salient Object Detection with a Focus on Filamentary Structures. Sensors, 25(10), 2990. https://doi.org/10.3390/s25102990

Vancouver

Ding Y, Chen W, Zhang G, Feng Z, Li X. Cross-Modal Weakly Supervised RGB-D Salient Object Detection with a Focus on Filamentary Structures. Sensors. 2025;25(10):2990. doi:10.3390/s25102990

BibTeX
@article{Ding2025,
  author = {Ding, Yifan and Chen, Weiwei and Zhang, Guomin and Feng, Zhaoming and Li, Xuan},
  title = {Cross-Modal Weakly Supervised RGB-D Salient Object Detection with a Focus on Filamentary Structures},
  journal = {Sensors},
  year = {2025},
  volume = {25},
  number = {10},
  pages = {2990},
  doi = {10.3390/s25102990}
}
Kostenlos starten →