EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

ACDF-YOLO: Attentive and Cross-Differential Fusion Network for Multimodal Remote Sensing Object Detection

Xuan Fei, Mengyao Guo, Yan Li, Renping Yu, Le Sun

Remote Sensing · 23.09.2024 · 16 (18) · 3532

DOI: 10.3390/rs16183532 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Remote Sensing, online erschienen am 23.09.2024. Verfasst von Xuan Fei und 4 weiteren Autor:innen. Die Arbeit wurde bisher 47-mal zitiert (Crossref) und nennt 46 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China, Key Technologies Research and Development Program of Henan Province, Ministry of Education Key Laboratory Open Funded Project for Grain Information Processing and Control.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Object detection in remote sensing images has received significant attention for a wide range of applications. However, traditional unimodal remote sensing images, whether based on visible light or infrared, have limitations that cannot be ignored. Visible light images are susceptible to ambient lighting conditions, and their detection accuracy can be greatly reduced. Infrared images often lack rich texture information, resulting in a high false-detection rate during target identification and classification. To address these challenges, we propose a novel multimodal fusion network detection model, named ACDF-YOLO, basedon the lightweight and efficient YOLOv5 structure, which aims to amalgamate synergistic data from both visible and infrared imagery, thereby enhancing the efficiency of target identification in remote sensing imagery. Firstly, a novel efficient shuffle attention module is designed to assist in extracting the features of various modalities. Secondly, deeper multimodal information fusion is achieved by introducing a new cross-modal difference module to fuse the features that have been acquired. Finally, we combine the two modules mentioned above in an effective manner to achieve ACDF. The ACDF not only enhances the characterization ability for the fused features but also further refines the capture and reinforcement of important channel features. Experimental validation was performed using several publicly available multimodal real-world and remote sensing datasets. Compared with other advanced unimodal and multimodal methods, ACDF-YOLO separately achieved a 95.87% and 78.10% mAP0.5 on the LLVIP and VEDAI datasets, demonstrating that the deep fusion of different modal information can effectively improve the accuracy of object detection.

Förderung

  • National Natural Science Foundation of China
  • Key Technologies Research and Development Program of Henan Province
  • Ministry of Education Key Laboratory Open Funded Project for Grain Information Processing and Control
  • Innovative Funds Plan of Henan University of Technology
  • Cultivation Programme for Young Backbone Teachers in Henan University of Technology

Zitieren

APA

Fei, X., Guo, M., Li, Y., Yu, R., & Sun, L. (2024). ACDF-YOLO: Attentive and Cross-Differential Fusion Network for Multimodal Remote Sensing Object Detection. Remote Sensing, 16(18), 3532. https://doi.org/10.3390/rs16183532

Vancouver

Fei X, Guo M, Li Y, Yu R, Sun L. ACDF-YOLO: Attentive and Cross-Differential Fusion Network for Multimodal Remote Sensing Object Detection. Remote Sensing. 2024;16(18):3532. doi:10.3390/rs16183532

BibTeX
@article{Fei2024,
  author = {Fei, Xuan and Guo, Mengyao and Li, Yan and Yu, Renping and Sun, Le},
  title = {ACDF-YOLO: Attentive and Cross-Differential Fusion Network for Multimodal Remote Sensing Object Detection},
  journal = {Remote Sensing},
  year = {2024},
  volume = {16},
  number = {18},
  pages = {3532},
  doi = {10.3390/rs16183532}
}
Kostenlos starten →