EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

RSAM: Vision-Language Two-Way Guidance for Referring Remote Sensing Image Segmentation

Zilong Zhao, Xin Xu, Bingxin Huang, Hongjia Chen, Fangling Pu

Remote Sensing · 08.12.2025 · 17 (24) · 3960

DOI: 10.3390/rs17243960 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Remote Sensing, online erschienen am 08.12.2025. Verfasst von Zilong Zhao und 4 weiteren Autor:innen. Die Arbeit wurde bisher 3-mal zitiert (Crossref) und nennt 60 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Referring remote sensing image segmentation (RRSIS) aims to accurately segment target objects in remote sensing images based on natural language instructions. Despite its growing relevance, progress in this field is constrained by limited datasets and weak cross-modal alignment. To support RRSIS research, we construct referring image segmentation in optical remote sensing (RISORS), a large-scale benchmark containing 36,697 instruction–mask pairs. RISORS provides diverse and high-quality samples that enable comprehensive experiment in remote sensing contexts. Building on this foundation, we propose Referring-SAM (RSAM), a novel framework that extends Segment Anything Model 2 to support text-prompted segmentation. RSAM integrates a Two-Way Guidance Module (TWGM) and a Multimodal Mask Decoder (MMMD). TWGM facilitates a two-way guidance mechanism that mutually refines image and text features, with positional encodings incorporated across all attention layers to significantly enhance relational reasoning. MMMD effectively separates textual prompts from spatial prompts, improving segmentation accuracy in complex multimodal settings. Extensive experiments on RISORS, as well as RefSegRS and RRSIS-D datasets, demonstrate that RSAM achieves state-of-the-art performance, particularly in segmenting small and diverse targets. Ablation studies further validate the individual contributions of TWGM and MMMD. This work provides a solid foundation for further developments in integrated vision-language analysis within remote sensing applications.

Förderung

  • National Natural Science Foundation of China

Zitieren

APA

Zhao, Z., Xu, X., Huang, B., Chen, H., & Pu, F. (2025). RSAM: Vision-Language Two-Way Guidance for Referring Remote Sensing Image Segmentation. Remote Sensing, 17(24), 3960. https://doi.org/10.3390/rs17243960

Vancouver

Zhao Z, Xu X, Huang B, Chen H, Pu F. RSAM: Vision-Language Two-Way Guidance for Referring Remote Sensing Image Segmentation. Remote Sensing. 2025;17(24):3960. doi:10.3390/rs17243960

BibTeX
@article{Zhao2025,
  author = {Zhao, Zilong and Xu, Xin and Huang, Bingxin and Chen, Hongjia and Pu, Fangling},
  title = {RSAM: Vision-Language Two-Way Guidance for Referring Remote Sensing Image Segmentation},
  journal = {Remote Sensing},
  year = {2025},
  volume = {17},
  number = {24},
  pages = {3960},
  doi = {10.3390/rs17243960}
}
Kostenlos starten →