EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

A Multi-Level Cross-Attention Image Registration Method for Visible and Infrared Small Unmanned Aerial Vehicle Targets via Image Style Transfer

Wen Jiang, Hanxin Pan, Yanping Wang, Yang Li, Yun Lin, Fukun Bi

Remote Sensing · 07.08.2024 · 16 (16) · 2880

DOI: 10.3390/rs16162880 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Remote Sensing, online erschienen am 07.08.2024. Verfasst von Wen Jiang und 5 weiteren Autor:innen. Die Arbeit wurde bisher 12-mal zitiert (Crossref) und nennt 29 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Small UAV target detection and tracking based on cross-modality image fusion have gained widespread attention. Due to the limited feature information available from small UAVs in images, where they occupy a minimal number of pixels, the precision required for detection and tracking algorithms is particularly high in complex backgrounds. Image fusion techniques can enrich the detailed information for small UAVs, showing significant advantages under extreme lighting conditions. Image registration is a fundamental step preceding image fusion. It is essential to achieve accurate image alignment before proceeding with image fusion to prevent severe ghosting and artifacts. This paper specifically focused on the alignment of small UAV targets within infrared and visible light imagery. To address this issue, this paper proposed a cross-modality image registration network based on deep learning, which includes a structure preservation and style transformation network (SPSTN) and a multi-level cross-attention residual registration network (MCARN). Firstly, the SPSTN is employed for modality transformation, transferring the cross-modality task into a single-modality task to reduce the information discrepancy between modalities. Then, the MCARN is utilized for single-modality image registration, capable of deeply extracting and fusing features from pseudo infrared and visible images to achieve efficient registration. To validate the effectiveness of the proposed method, comprehensive experimental evaluations were conducted on the Anti-UAV dataset. The extensive evaluation results validate the superiority and universality of the cross-modality image registration framework proposed in this paper, which plays a crucial role in subsequent image fusion tasks for more effective target detection.

Zitieren

APA

Jiang, W., Pan, H., Wang, Y., Li, Y., Lin, Y., & Bi, F. (2024). A Multi-Level Cross-Attention Image Registration Method for Visible and Infrared Small Unmanned Aerial Vehicle Targets via Image Style Transfer. Remote Sensing, 16(16), 2880. https://doi.org/10.3390/rs16162880

Vancouver

Jiang W, Pan H, Wang Y, Li Y, Lin Y, Bi F. A Multi-Level Cross-Attention Image Registration Method for Visible and Infrared Small Unmanned Aerial Vehicle Targets via Image Style Transfer. Remote Sensing. 2024;16(16):2880. doi:10.3390/rs16162880

BibTeX
@article{Jiang2024,
  author = {Jiang, Wen and Pan, Hanxin and Wang, Yanping and Li, Yang and Lin, Yun and Bi, Fukun},
  title = {A Multi-Level Cross-Attention Image Registration Method for Visible and Infrared Small Unmanned Aerial Vehicle Targets via Image Style Transfer},
  journal = {Remote Sensing},
  year = {2024},
  volume = {16},
  number = {16},
  pages = {2880},
  doi = {10.3390/rs16162880}
}
Kostenlos starten →