DFEN: Dual Feature Enhancement Network for Remote Sensing Image Caption
Electronics · 2023-03-25 · 12 (7) · 1547
DOI: 10.3390/electronics12071547 ↗At a glance
Journal article in Electronics, published online on 2023-03-25. Written by Weihua Zhao and 3 co-authors. Cited 14 times so far (Crossref); 27 references. The full text is freely available (open access, CC BY 4.0). Funded by: Natural Science Foundation of China, Autonomous Region Science and Technology Program.
Abstract (original language)
The remote sensing image caption can acquire ground objects and the semantic relationships between different ground objects. Existing remote sensing image caption algorithms do not acquire enough ground object information from remote-sensing images, resulting in inaccurate captions. As a result, this paper proposes a codec-based Dual Feature Enhancement Network (“DFEN”) to enhance ground object information from both image and text levels. We build the Image-Enhancement module at the image level using the multiscale characteristics of remote sensing images. Furthermore, more discriminative image context features are obtained through the Image-Enhancement module. The hierarchical attention mechanism aggregates multi-level features and supplements the ground object information ignored due to large-scale differences. At the text level, we use the image’s potential visual features to guide the Text-Enhance module, resulting in text guidance features that correctly focus on the information of the ground objects. Experiment results show that the DFEN model can enhance ground object information from images and text. Specifically, the BLEU-1 index increased by 8.6% in UCM-caption, 2.3% in Sydney-caption, and 5.1% in RSICD. The DFEN model has promoted the exploration of advanced semantics of remote sensing images and facilitated the development of remote sensing image caption.
Funding
- Natural Science Foundation of China
- Autonomous Region Science and Technology Program
Cite
APA
Zhao, W., Yang, W., Chen, D., & Wei, F. (2023). DFEN: Dual Feature Enhancement Network for Remote Sensing Image Caption. Electronics, 12(7), 1547. https://doi.org/10.3390/electronics12071547
Vancouver
Zhao W, Yang W, Chen D, Wei F. DFEN: Dual Feature Enhancement Network for Remote Sensing Image Caption. Electronics. 2023;12(7):1547. doi:10.3390/electronics12071547
BibTeX
@article{Zhao2023,
author = {Zhao, Weihua and Yang, Wenzhong and Chen, Danny and Wei, Fuyuan},
title = {DFEN: Dual Feature Enhancement Network for Remote Sensing Image Caption},
journal = {Electronics},
year = {2023},
volume = {12},
number = {7},
pages = {1547},
doi = {10.3390/electronics12071547}
}
EUVIMED