EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

SRGFormer: Semantic Role-Guided Graph Reasoning for Referring Remote Sensing Image Segmentation

Libang Liu iD, Jianxiang Li iD, Yaqin Li iD, Cao Yuan iD, Lili Fan iD, Xinyu Xiong iD, Wei Huang iD

Sensors · 22.07.2026 · 26 (14) · 4657

DOI: 10.3390/s26144657 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Sensors, online erschienen am 22.07.2026. Verfasst von Libang Liu und 6 weiteren Autor:innen. Beteiligte Einrichtung: School of Mathematics and Computer Science, Wuhan Polytechnic University, Wuhan 430023, China. Die Arbeit nennt 46 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Referring remote sensing image segmentation (RRSIS) aims to segment a target instance from remote sensing imagery according to a natural-language expression. It provides a flexible way to retrieve and localize specific objects in remote sensing scenes, benefiting intelligent Earth observation applications. Although existing methods have achieved promising progress by strengthening vision–language alignment, most of them still represent the expression as a holistic language feature and rely on convolution-dominated decoding for mask prediction. Such a paradigm tends to entangle target category, inter-object relation, and spatial position cues, making it difficult to distinguish the intended instance from multiple same-class distractors in complex remote sensing scenes. To address this limitation, we propose SRGFormer, a graph reasoning framework for RRSIS. Specifically, a semantic role decomposition (SRD) module decomposes the referring expression into target, relation, and position semantics, providing explicit linguistic priors for instance-level localization. Guided by the decomposed relation semantics, a semantic-relational graph transformer (SRGT) performs relation-aware graph reasoning over fused multi-scale visual features, enabling long-range dependency modeling among spatially distributed candidate instances. Furthermore, a progressive mask refinement (PMR) module continuously injects the decomposed semantic priors into semantic modulation, query initialization, and iterative mask decoding, thereby alleviating semantic fading during mask generation. Extensive experiments demonstrate that SRGFormer achieves substantial improvements on RefSegRS, attaining 66.08% mIoU and 76.93% oIoU (surpassing the prior state of the art by 3.96% and 2.83%, respectively) along with a notable 15.95% gain in Pr@0.7. Experiments on the additional RRSIS-D benchmark further demonstrate the general applicability of our approach, where SRGFormer maintains competitive performance (65.87% mIoU and 24.61% Pr@0.9) against existing methods. These results demonstrate that the proposed framework improves target localization and fine-grained mask prediction in complex remote sensing scenes.

Schlagwörter

Stichwörter der Autor:innen

graph transformerprogressive mask refinementreferring remote sensing image segmentationrelation-aware graph reasoningsemantic role decompositionvision–language segmentation

Autor:innen und Institutionen

  • School of Mathematics and Computer Science, Wuhan Polytechnic University, Wuhan 430023, China.
  • School of Computer Science and Engineering, Sun Yat-sen University, Guangzhou 510006, China.

ORCID-Profile: Libang Liu, Jianxiang Li, Yaqin Li, Cao Yuan, Lili Fan, Xinyu Xiong, Wei Huang

Förderung

  • National Natural Science Foundation of China

Zitieren

APA

Liu, L., Li, J., Li, Y., Yuan, C., Fan, L., Xiong, X., & Huang, W. (2026). SRGFormer: Semantic Role-Guided Graph Reasoning for Referring Remote Sensing Image Segmentation. Sensors, 26(14), 4657. https://doi.org/10.3390/s26144657

Vancouver

Liu L, Li J, Li Y, Yuan C, Fan L, Xiong X, et al. SRGFormer: Semantic Role-Guided Graph Reasoning for Referring Remote Sensing Image Segmentation. Sensors. 2026;26(14):4657. doi:10.3390/s26144657

BibTeX
@article{Liu2026,
  author = {Liu, Libang and Li, Jianxiang and Li, Yaqin and Yuan, Cao and Fan, Lili and Xiong, Xinyu and Huang, Wei},
  title = {SRGFormer: Semantic Role-Guided Graph Reasoning for Referring Remote Sensing Image Segmentation},
  journal = {Sensors},
  year = {2026},
  volume = {26},
  number = {14},
  pages = {4657},
  doi = {10.3390/s26144657}
}
Kostenlos starten →