EUVIMEDOpdag EUVIMED
Open access · CC BY 4.0

DFEN: Dual Feature Enhancement Network for Remote Sensing Image Caption

Weihua Zhao, Wenzhong Yang, Danny Chen, Fuyuan Wei

Electronics · 2023-03-25 · 12 (7) · 1547

DOI: 10.3390/electronics12071547 ↗

At a glance

Journal article in Electronics, published online on 2023-03-25. Written by Weihua Zhao and 3 co-authors. Cited 14 times so far (Crossref); 27 references. The full text is freely available (open access, CC BY 4.0). Funded by: Natural Science Foundation of China, Autonomous Region Science and Technology Program.

AbstractBibliografiske oplysningerCiteRelated studies

Abstract (original language)

The remote sensing image caption can acquire ground objects and the semantic relationships between different ground objects. Existing remote sensing image caption algorithms do not acquire enough ground object information from remote-sensing images, resulting in inaccurate captions. As a result, this paper proposes a codec-based Dual Feature Enhancement Network (“DFEN”) to enhance ground object information from both image and text levels. We build the Image-Enhancement module at the image level using the multiscale characteristics of remote sensing images. Furthermore, more discriminative image context features are obtained through the Image-Enhancement module. The hierarchical attention mechanism aggregates multi-level features and supplements the ground object information ignored due to large-scale differences. At the text level, we use the image’s potential visual features to guide the Text-Enhance module, resulting in text guidance features that correctly focus on the information of the ground objects. Experiment results show that the DFEN model can enhance ground object information from images and text. Specifically, the BLEU-1 index increased by 8.6% in UCM-caption, 2.3% in Sydney-caption, and 5.1% in RSICD. The DFEN model has promoted the exploration of advanced semantics of remote sensing images and facilitated the development of remote sensing image caption.

Funding

  • Natural Science Foundation of China
  • Autonomous Region Science and Technology Program

Cite

APA

Zhao, W., Yang, W., Chen, D., & Wei, F. (2023). DFEN: Dual Feature Enhancement Network for Remote Sensing Image Caption. Electronics, 12(7), 1547. https://doi.org/10.3390/electronics12071547

Vancouver

Zhao W, Yang W, Chen D, Wei F. DFEN: Dual Feature Enhancement Network for Remote Sensing Image Caption. Electronics. 2023;12(7):1547. doi:10.3390/electronics12071547

BibTeX
@article{Zhao2023,
  author = {Zhao, Weihua and Yang, Wenzhong and Chen, Danny and Wei, Fuyuan},
  title = {DFEN: Dual Feature Enhancement Network for Remote Sensing Image Caption},
  journal = {Electronics},
  year = {2023},
  volume = {12},
  number = {7},
  pages = {1547},
  doi = {10.3390/electronics12071547}
}
Start for free →