Triple-Domain Feature Learning With Frequency-Aware Memory Enhancement for Moving Infrared Small Target Detection
IEEE Transactions on Geoscience and Remote Sensing · 2024 · 62 · 1-14
DOI: 10.1109/tgrs.2024.3452175 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Geoscience and Remote Sensing, 2024. Verfasst von Weiwei Duan und 4 weiteren Autor:innen. Die Arbeit wurde bisher 73-mal zitiert (Crossref) und nennt 57 Literaturangaben. Gefördert von: Aeronautical Science Foundation of China, National Natural Science Foundation of China.
Abstract (Originalsprache)
As a subfield of object detection, moving infrared small target detection (ISTD) presents significant challenges due to tiny target sizes and low contrast against backgrounds. Currently existing methods primarily rely on the features extracted only from spatiotemporal domain. Frequency domain has hardly been concerned yet, although it has been widely applied in image processing. To extend feature source domains and enhance feature representation, we propose a new triple-domain strategy (Tridos) with the frequency-aware memory enhancement on spatiotemporal domain for ISTD. In this scheme, it effectively detaches and enhances frequency features by a local-global frequency-aware module (LGFM) with Fourier transform (FT). Inspired by human visual system (HVS), our memory enhancement is designed to capture the spatial relationships of infrared targets among video frames. Furthermore, it encodes temporal dynamics motion features via differential learning and residual enhancing. In addition, we further design a residual compensation to reconcile possible cross-domain feature mismatches. To our best knowledge, proposed Tridos is the first work to explore infrared target feature learning comprehensively in spatiotemporal-frequency domains. The extensive experiments on three datasets (i.e., DAUB, ITSDT-15K, and IRDST) validate that our triple-domain infrared feature learning scheme could often be obviously superior to state-of-the-art (SOTA) ones. Source codes are available at https://github.com/UESTC-nnLab/Tridos.
Förderung
- Aeronautical Science Foundation of China
- National Natural Science Foundation of China
Zitieren
APA
Duan, W., Ji, L., Chen, S., Zhu, S., & Ye, M. (2024). Triple-Domain Feature Learning With Frequency-Aware Memory Enhancement for Moving Infrared Small Target Detection. IEEE Transactions on Geoscience and Remote Sensing, 62, 1-14. https://doi.org/10.1109/tgrs.2024.3452175
Vancouver
Duan W, Ji L, Chen S, Zhu S, Ye M. Triple-Domain Feature Learning With Frequency-Aware Memory Enhancement for Moving Infrared Small Target Detection. IEEE Transactions on Geoscience and Remote Sensing. 2024;62:1-14. doi:10.1109/tgrs.2024.3452175
BibTeX
@article{Duan2024,
author = {Duan, Weiwei and Ji, Luping and Chen, Shengjia and Zhu, Sicheng and Ye, Mao},
title = {Triple-Domain Feature Learning With Frequency-Aware Memory Enhancement for Moving Infrared Small Target Detection},
journal = {IEEE Transactions on Geoscience and Remote Sensing},
year = {2024},
volume = {62},
pages = {1--14},
doi = {10.1109/tgrs.2024.3452175}
}
EUVIMED