Harnessing Foundation Models for Optical–SAR Object Detection via Gated–Guided Fusion
ISPRS International Journal of Geo-Information · 08.04.2026 · 15 (4) · 160
DOI: 10.3390/ijgi15040160 ↗Kurz gefasst
Fachartikel in der Zeitschrift ISPRS International Journal of Geo-Information, online erschienen am 08.04.2026. Verfasst von Qianyin Jiang und 3 weiteren Autor:innen. Die Arbeit wurde bisher 3-mal zitiert (Crossref) und nennt 41 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Natural Science Foundation of Guangdong Province, Guangzhou Municipal Education Bureau’s University Scientific Research Project.
Abstract (Originalsprache)
Remote sensing object detection is fundamental to Earth observation, yet remains challenging when relying on a single sensing modality. While optical imagery provides rich spatial and textural details, it is highly sensitive to illumination and adverse weather; conversely, Synthetic Aperture Radar (SAR) offers robust all-weather acquisition but suffers from speckle noise and limited semantic interpretability. To address these limitations, we leverage the potential of foundation models for optical–SAR object detection via a novel gated–guided fusion approach. By integrating transferable and generalizable representations from foundation models into the detection pipeline, we enhance semantic expressiveness and cross-environment robustness. Specifically, a gated–guided fusion mechanism is designed to selectively merge cross-modal features with foundational priors, enabling the network to prioritize informative cues while suppressing unreliable signals in complex scenes. Furthermore, we propose a dual-stream architecture incorporating attention mechanisms and State Space Models (SSMs) to simultaneously capture local and long-range dependencies. Extensive experiments on the large-scale M4-SAR dataset demonstrate that our method achieves state-of-the-art performance, significantly improving detection accuracy and robustness under challenging sensing conditions.
Förderung
- Natural Science Foundation of Guangdong Province
- Guangzhou Municipal Education Bureau’s University Scientific Research Project
Zitieren
APA
Jiang, Q., Liao, J., Lin, Q., & Zhang, J. (2026). Harnessing Foundation Models for Optical–SAR Object Detection via Gated–Guided Fusion. ISPRS International Journal of Geo-Information, 15(4), 160. https://doi.org/10.3390/ijgi15040160
Vancouver
Jiang Q, Liao J, Lin Q, Zhang J. Harnessing Foundation Models for Optical–SAR Object Detection via Gated–Guided Fusion. ISPRS International Journal of Geo-Information. 2026;15(4):160. doi:10.3390/ijgi15040160
BibTeX
@article{Jiang2026,
author = {Jiang, Qianyin and Liao, Jianshang and Lin, Qiuyu and Zhang, Junkang},
title = {Harnessing Foundation Models for Optical–SAR Object Detection via Gated–Guided Fusion},
journal = {ISPRS International Journal of Geo-Information},
year = {2026},
volume = {15},
number = {4},
pages = {160},
doi = {10.3390/ijgi15040160}
}
EUVIMED