EUVIMEDEUVIMED entdecken
Crossref

Context-Aware Local–Global Semantic Alignment for Remote Sensing Image–Text Retrieval

Xiumei Chen, Xiangtao Zheng, Xiaoqiang Lu

IEEE Transactions on Geoscience and Remote Sensing · 2025 · 63 · 1-12

DOI: 10.1109/tgrs.2025.3552304 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Geoscience and Remote Sensing, 2025. Verfasst von Xiumei Chen und 2 weiteren Autor:innen. Die Arbeit wurde bisher 23-mal zitiert (Crossref) und nennt 52 Literaturangaben. Gefördert von: National Natural Science Foundation of China, National Science Fund for Distinguished Young Scholars.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Remote sensing image-text retrieval (RSITR) is a cross-modal task that integrates visual and textual information, attracting significant attention in remote sensing research. Remote sensing images typically contain complex scenes with abundant details, presenting significant challenges for accurate semantic alignment between images and texts. Despite advances in the field, achieving precise alignment in such intricate contexts remains a major hurdle. To address this challenge, this article introduces a novel context-aware local-global semantic alignment (CLGSA) method. The proposed method consists of two key modules: the local key feature alignment (LKFA) module and the cross-sample global semantic alignment (CGSA) module. The LKFA module incorporates a local image masking and reconstruction task to improve the alignment between image and text features. Specifically, this module masks certain regions of the image and uses text context information to guide the reconstruction of the masked areas, enhancing the alignment of local semantics and ensuring more accurate retrieval of region-specific content. The CGSA module employs a hard sample triplet loss to improve global semantic consistency. By prioritizing difficult samples during training, this module refines feature space distributions, helping the model better capture global semantics across the entire image-text pair. A series of extensive experiments demonstrates the effectiveness of the proposed method. The method achieves an mR score of 32.07% on the RSICD dataset and 46.63% on the RSITMD dataset, outperforming baseline methods and confirming the robustness and accuracy of the approach.

Förderung

  • National Natural Science Foundation of China
  • National Science Fund for Distinguished Young Scholars

Zitieren

APA

Chen, X., Zheng, X., & Lu, X. (2025). Context-Aware Local–Global Semantic Alignment for Remote Sensing Image–Text Retrieval. IEEE Transactions on Geoscience and Remote Sensing, 63, 1-12. https://doi.org/10.1109/tgrs.2025.3552304

Vancouver

Chen X, Zheng X, Lu X. Context-Aware Local–Global Semantic Alignment for Remote Sensing Image–Text Retrieval. IEEE Transactions on Geoscience and Remote Sensing. 2025;63:1-12. doi:10.1109/tgrs.2025.3552304

BibTeX
@article{Chen2025,
  author = {Chen, Xiumei and Zheng, Xiangtao and Lu, Xiaoqiang},
  title = {Context-Aware Local–Global Semantic Alignment for Remote Sensing Image–Text Retrieval},
  journal = {IEEE Transactions on Geoscience and Remote Sensing},
  year = {2025},
  volume = {63},
  pages = {1--12},
  doi = {10.1109/tgrs.2025.3552304}
}
Kostenlos starten →