EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

TGF-Net: Transformer and gist CNN fusion network for multi-modal remote sensing image classification

Huiqing Wang iD, Huajun Wang, Linfen Wu

PLOS ONE · 19.02.2025 · 20 (2) · e0316900

DOI: 10.1371/journal.pone.0316900 ↗

Kurz gefasst

Fachartikel in der Zeitschrift PLOS ONE, online erschienen am 19.02.2025. Verfasst von Huiqing Wang und 2 weiteren Autor:innen. Beteiligte Einrichtung: Center for Information and Educational Technology, Southwest Medical University, Luzhou, Sichuan, China. Hauptthemen laut MEDLINE: Neural Networks, Computer, Remote Sensing Technology, Image Processing, Computer-Assisted. Die Arbeit wurde bisher 11-mal zitiert (Crossref) und nennt 36 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Ministry of Education collaborative education project.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

In the field of earth sciences and remote exploration, the classification and identification of surface materials on earth have been a significant research area that poses considerable challenges in recent times. Although deep learning technology has achieved certain results in remote sensing image classification, it still has certain challenges for multi-modality remote sensing data classification. In this paper, we propose a fusion network based on transformer and gist convolutional neural network (CNN), namely TGF-Net. To minimize the duplication of information in multimodal data, the TGF-Net network incorporates a feature reconstruction module (FRM) that employs matrix factorization and self-attention mechanism for decomposing and evaluating the similarity of multimodal features. This enables the extraction of distinct as well as common features. Meanwhile, the transformer-based spectral feature extraction module (TSFEM) was designed by combining the different characteristics of remote sensing images and considering the problem of orderliness of the sequence between hyperspectral image (HSI) channels. In order to address the issue of representing the relative positions of spatial targets in synthetic aperture radar (SAR) images, we proposed a spatial feature extraction module called gist-based spatial feature extraction module (GSFEM). To assess the efficacy and superiority of the proposed TGF-Net, we performed experiments on two datasets comprising HSI and SAR data.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Neural Networks, ComputerRemote Sensing TechnologyImage Processing, Computer-AssistedDeep LearningAlgorithms

Autor:innen und Institutionen

  • Center for Information and Educational Technology, Southwest Medical University, Luzhou, Sichuan, China.
  • School of Geophysics, Chengdu University of Technology, Chengdu, Sichuan, China.
  • College of Health and Intelligent Engineering, Chengdu Medical College, Chengdu, Sichuan, China.

ORCID-Profile: Huiqing Wang

Förderung

  • Ministry of Education collaborative education project

Zitieren

APA

Wang, H., Wang, H., & Wu, L. (2025). TGF-Net: Transformer and gist CNN fusion network for multi-modal remote sensing image classification. PLOS ONE, 20(2), e0316900. https://doi.org/10.1371/journal.pone.0316900

Vancouver

Wang H, Wang H, Wu L. TGF-Net: Transformer and gist CNN fusion network for multi-modal remote sensing image classification. PLOS ONE. 2025;20(2):e0316900. doi:10.1371/journal.pone.0316900

BibTeX
@article{Wang2025,
  author = {Wang, Huiqing and Wang, Huajun and Wu, Linfen},
  title = {TGF-Net: Transformer and gist CNN fusion network for multi-modal remote sensing image classification},
  journal = {PLOS ONE},
  year = {2025},
  volume = {20},
  number = {2},
  pages = {e0316900},
  doi = {10.1371/journal.pone.0316900}
}
Kostenlos starten →