EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Leveraging Visual Language Model and Generative Diffusion Model for Zero-Shot SAR Target Recognition

Junyu Wang, Hao Sun, Tao Tang, Yuli Sun, Qishan He, Lin Lei, Kefeng Ji

Remote Sensing · 09.08.2024 · 16 (16) · 2927

DOI: 10.3390/rs16162927 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Remote Sensing, online erschienen am 09.08.2024. Verfasst von Junyu Wang und 6 weiteren Autor:innen. Die Arbeit wurde bisher 13-mal zitiert (Crossref) und nennt 60 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China, Natural Science Foundation of Hunan Province of China, Postdoctoral Fellowship Program of CPSF.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Simulated data play an important role in SAR target recognition, particularly under zero-shot learning (ZSL) conditions caused by the lack of training samples. The traditional SAR simulation method is based on manually constructing target 3D models for electromagnetic simulation, which is costly and limited by the target’s prior knowledge base. Also, the unavoidable discrepancy between simulated SAR and measured SAR makes the traditional simulation method more limited for target recognition. This paper proposes an innovative SAR simulation method based on a visual language model and generative diffusion model by extracting target semantic information from optical remote sensing images and transforming it into a 3D model for SAR simulation to address the challenge of SAR target recognition under ZSL conditions. Additionally, to reduce the domain shift between the simulated domain and the measured domain, we propose a domain adaptation method based on dynamic weight domain loss and classification loss. The effectiveness of semantic information-based 3D models has been validated on the MSTAR dataset and the feasibility of the proposed framework has been validated on the self-built civilian vehicle dataset. The experimental results demonstrate that the first proposed SAR simulation method based on a visual language model and generative diffusion model can effectively improve target recognition performance under ZSL conditions.

Förderung

  • National Natural Science Foundation of China
  • Natural Science Foundation of Hunan Province of China
  • Postdoctoral Fellowship Program of CPSF

Zitieren

APA

Wang, J., Sun, H., Tang, T., Sun, Y., He, Q., Lei, L., & Ji, K. (2024). Leveraging Visual Language Model and Generative Diffusion Model for Zero-Shot SAR Target Recognition. Remote Sensing, 16(16), 2927. https://doi.org/10.3390/rs16162927

Vancouver

Wang J, Sun H, Tang T, Sun Y, He Q, Lei L, et al. Leveraging Visual Language Model and Generative Diffusion Model for Zero-Shot SAR Target Recognition. Remote Sensing. 2024;16(16):2927. doi:10.3390/rs16162927

BibTeX
@article{Wang2024,
  author = {Wang, Junyu and Sun, Hao and Tang, Tao and Sun, Yuli and He, Qishan and Lei, Lin and Ji, Kefeng},
  title = {Leveraging Visual Language Model and Generative Diffusion Model for Zero-Shot SAR Target Recognition},
  journal = {Remote Sensing},
  year = {2024},
  volume = {16},
  number = {16},
  pages = {2927},
  doi = {10.3390/rs16162927}
}
Kostenlos starten →