EUVIMEDEUVIMED entdecken
Crossref

RS-Mamba for Large Remote Sensing Image Dense Prediction

Sijie Zhao, Hao Chen, Xueliang Zhang, Pengfeng Xiao, Lei Bai, Wanli Ouyang

IEEE Transactions on Geoscience and Remote Sensing · 2024 · 62 · 1-14

DOI: 10.1109/tgrs.2024.3425540 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Geoscience and Remote Sensing, 2024. Verfasst von Sijie Zhao und 5 weiteren Autor:innen. Die Arbeit wurde bisher 340-mal zitiert (Crossref) und nennt 66 Literaturangaben. Gefördert von: Shanghai Artificial Intelligence Laboratory, National Natural Science Foundation of China, AI and AI for Science Project of Nanjing University.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Context modeling is critical for remote sensing image dense prediction tasks. Nowadays, the growing size of very-high-resolution (VHR) remote sensing images poses challenges in effectively modeling context. While transformer-based models possess global modeling capabilities, they encounter computational challenges when applied to large VHR images due to their quadratic complexity. The conventional practice of cropping large images into smaller patches results in a notable loss of contextual information. To address these issues, we propose the remote sensing Mamba (RSM) for dense prediction tasks in large VHR remote sensing images. RSM is specifically designed to capture the global context of remote sensing images with linear complexity, facilitating the effective processing of large VHR images. Considering that the land covers in remote sensing images are distributed in arbitrary spatial directions due to characteristics of remote sensing over-head imaging, the RSM incorporates an omnidirectional selective scan module (OSSM) to globally model the context of images in multiple directions, capturing large spatial features from various directions. We designed simple yet effective models based on RSM, achieving state-of-the-art performance on dense prediction tasks in VHR remote sensing images without fancy training strategies. Extensive experiments on semantic segmentation (SS) and change detection (CD) tasks across various land covers demonstrate the effectiveness of the proposed RSM. Leveraging the linear complexity and global modeling capabilities, RSM achieves better efficiency and accuracy than transformer-based models on large remote sensing images. Interestingly, we also demonstrated that our model generally performs better with a larger image size on dense prediction tasks.

Förderung

  • Shanghai Artificial Intelligence Laboratory
  • National Natural Science Foundation of China
  • AI and AI for Science Project of Nanjing University
  • Fundamental Research Funds for the Central Universities
  • Youth Innovation Team of China Meteorological Administration

Zitieren

APA

Zhao, S., Chen, H., Zhang, X., Xiao, P., Bai, L., & Ouyang, W. (2024). RS-Mamba for Large Remote Sensing Image Dense Prediction. IEEE Transactions on Geoscience and Remote Sensing, 62, 1-14. https://doi.org/10.1109/tgrs.2024.3425540

Vancouver

Zhao S, Chen H, Zhang X, Xiao P, Bai L, Ouyang W. RS-Mamba for Large Remote Sensing Image Dense Prediction. IEEE Transactions on Geoscience and Remote Sensing. 2024;62:1-14. doi:10.1109/tgrs.2024.3425540

BibTeX
@article{Zhao2024,
  author = {Zhao, Sijie and Chen, Hao and Zhang, Xueliang and Xiao, Pengfeng and Bai, Lei and Ouyang, Wanli},
  title = {RS-Mamba for Large Remote Sensing Image Dense Prediction},
  journal = {IEEE Transactions on Geoscience and Remote Sensing},
  year = {2024},
  volume = {62},
  pages = {1--14},
  doi = {10.1109/tgrs.2024.3425540}
}
Kostenlos starten →