EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Harnessing Foundation Models for Optical–SAR Object Detection via Gated–Guided Fusion

Qianyin Jiang, Jianshang Liao, Qiuyu Lin, Junkang Zhang

ISPRS International Journal of Geo-Information · 08.04.2026 · 15 (4) · 160

DOI: 10.3390/ijgi15040160 ↗

Kurz gefasst

Fachartikel in der Zeitschrift ISPRS International Journal of Geo-Information, online erschienen am 08.04.2026. Verfasst von Qianyin Jiang und 3 weiteren Autor:innen. Die Arbeit wurde bisher 3-mal zitiert (Crossref) und nennt 41 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Natural Science Foundation of Guangdong Province, Guangzhou Municipal Education Bureau’s University Scientific Research Project.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Remote sensing object detection is fundamental to Earth observation, yet remains challenging when relying on a single sensing modality. While optical imagery provides rich spatial and textural details, it is highly sensitive to illumination and adverse weather; conversely, Synthetic Aperture Radar (SAR) offers robust all-weather acquisition but suffers from speckle noise and limited semantic interpretability. To address these limitations, we leverage the potential of foundation models for optical–SAR object detection via a novel gated–guided fusion approach. By integrating transferable and generalizable representations from foundation models into the detection pipeline, we enhance semantic expressiveness and cross-environment robustness. Specifically, a gated–guided fusion mechanism is designed to selectively merge cross-modal features with foundational priors, enabling the network to prioritize informative cues while suppressing unreliable signals in complex scenes. Furthermore, we propose a dual-stream architecture incorporating attention mechanisms and State Space Models (SSMs) to simultaneously capture local and long-range dependencies. Extensive experiments on the large-scale M4-SAR dataset demonstrate that our method achieves state-of-the-art performance, significantly improving detection accuracy and robustness under challenging sensing conditions.

Förderung

  • Natural Science Foundation of Guangdong Province
  • Guangzhou Municipal Education Bureau’s University Scientific Research Project

Zitieren

APA

Jiang, Q., Liao, J., Lin, Q., & Zhang, J. (2026). Harnessing Foundation Models for Optical–SAR Object Detection via Gated–Guided Fusion. ISPRS International Journal of Geo-Information, 15(4), 160. https://doi.org/10.3390/ijgi15040160

Vancouver

Jiang Q, Liao J, Lin Q, Zhang J. Harnessing Foundation Models for Optical–SAR Object Detection via Gated–Guided Fusion. ISPRS International Journal of Geo-Information. 2026;15(4):160. doi:10.3390/ijgi15040160

BibTeX
@article{Jiang2026,
  author = {Jiang, Qianyin and Liao, Jianshang and Lin, Qiuyu and Zhang, Junkang},
  title = {Harnessing Foundation Models for Optical–SAR Object Detection via Gated–Guided Fusion},
  journal = {ISPRS International Journal of Geo-Information},
  year = {2026},
  volume = {15},
  number = {4},
  pages = {160},
  doi = {10.3390/ijgi15040160}
}
Kostenlos starten →