EUVIMEDEUVIMED entdecken
Crossref

Efficient Grounding DINO: Efficient Cross-Modality Fusion and Efficient Label Assignment for Visual Grounding in Remote Sensing

Zibo Hu, Kun Gao, Xiaodian Zhang, Zhijia Yang, Mingfeng Cai, Zhenyu Zhu, Wei Li

IEEE Transactions on Geoscience and Remote Sensing · 2025 · 63 · 1-14

DOI: 10.1109/tgrs.2025.3536015 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Geoscience and Remote Sensing, 2025. Verfasst von Zibo Hu und 6 weiteren Autor:innen. Die Arbeit wurde bisher 16-mal zitiert (Crossref) und nennt 51 Literaturangaben. Gefördert von: National Natural Science Foundation of China.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Visual grounding for remote sensing (RSVG) aims to detect objects in remote sensing scenes based on textual descriptions. While existing methods perform well on RSVG datasets, they are limited to single-object predictions, making them unsuitable for multi-object candidate category datasets. Open-set methods can be applied to both RSVG and candidate datasets, but their use in remote sensing remains rare. To bridge this gap, we introduce the open-set approach to RSVG and propose Efficient Grounding DINO, using Grounding DINO as a baseline. Open-set methods rely on two key modules: cross-modality fusion and label assignment. Existing cross-modality fusion methods simultaneously update text and multi-scale visual features, which hampers the model’s ability to generalize under different texts and increases learning complexity. Existing methods predict a single object, allowing direct use as a positive example for loss calculation, while open-set methods for multi-objects require one-to-one matching to assign positive and negative samples. However, background interference in the RSVG datasets causes frequent misassignments, slowing model convergence. We address these issues with two innovations: the multi-scale image-to-text fusion module (MSITFM), which updates text features using self-attention to maintain independence from visual features and employs scale-specific cross-attention for multi-scale visual feature fusion to reduce learning complexity, achieving a 3% parameter and 21.6% GFLOPs reduction. Text confidence matching (TCM) incorporates IoU-based confidence into label assignment to reduce mismatches and enhance model performance. Experiments on DIOR-RSVG, RSVG-HR, and DOTA datasets validate the effectiveness of our approach.

Förderung

  • National Natural Science Foundation of China

Zitieren

APA

Hu, Z., Gao, K., Zhang, X., Yang, Z., Cai, M., Zhu, Z., & Li, W. (2025). Efficient Grounding DINO: Efficient Cross-Modality Fusion and Efficient Label Assignment for Visual Grounding in Remote Sensing. IEEE Transactions on Geoscience and Remote Sensing, 63, 1-14. https://doi.org/10.1109/tgrs.2025.3536015

Vancouver

Hu Z, Gao K, Zhang X, Yang Z, Cai M, Zhu Z, et al. Efficient Grounding DINO: Efficient Cross-Modality Fusion and Efficient Label Assignment for Visual Grounding in Remote Sensing. IEEE Transactions on Geoscience and Remote Sensing. 2025;63:1-14. doi:10.1109/tgrs.2025.3536015

BibTeX
@article{Hu2025,
  author = {Hu, Zibo and Gao, Kun and Zhang, Xiaodian and Yang, Zhijia and Cai, Mingfeng and Zhu, Zhenyu and Li, Wei},
  title = {Efficient Grounding DINO: Efficient Cross-Modality Fusion and Efficient Label Assignment for Visual Grounding in Remote Sensing},
  journal = {IEEE Transactions on Geoscience and Remote Sensing},
  year = {2025},
  volume = {63},
  pages = {1--14},
  doi = {10.1109/tgrs.2025.3536015}
}
Kostenlos starten →