MMYFnet: Multi-Modality YOLO Fusion Network for Object Detection in Remote Sensing Images
Remote Sensing · 27.11.2024 · 16 (23) · 4451
DOI: 10.3390/rs16234451 ↗Kurz gefasst
Fachartikel in der Zeitschrift Remote Sensing, online erschienen am 27.11.2024. Verfasst von Huinan Guo und 4 weiteren Autor:innen. Die Arbeit wurde bisher 25-mal zitiert (Crossref) und nennt 56 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China General Program, Shaanxi Provincial Key Research and Develop Programme General Project.
Abstract (Originalsprache)
Object detection in remote sensing images is crucial for airport management, hazard prevention, traffic monitoring, and more. The precise ability for object localization and identification enables remote sensing imagery to provide early warnings, mitigate risks, and offer strong support for decision-making processes. While traditional deep learning-based object detection techniques have achieved significant results in single-modal environments, their detection capabilities still encounter challenges when confronted with complex environments, such as adverse weather conditions or situations where objects are obscured. To overcome the limitations of existing fusion methods in terms of complexity and insufficient information utilization, we innovatively propose a Cosine Similarity-based Image Feature Fusion (CSIFF) module and integrate it into a dual-branch YOLOv8 network, constructing a lightweight and efficient target detection network called Multi-Modality YOLO Fusion Network (MMYFNet). This network utilizes cosine similarity to divide the original features into common features and specific features, which are then refined and fused through specific modules. Experimental and analytical results show that MMYFNet performs excellently on both the VEDAI and FLIR datasets, achieving mAP values of 80% and 76.8%, respectively. Further validation through parameter sensitivity experiments, ablation studies, and visual analyses confirms the effectiveness of the CSIFF module. MMYFNet achieves high detection accuracy with fewer parameters, and the CSIFF module, as a plug-and-play module, can be integrated into other CNN-based cross-modality network models, providing a new approach for object detection in remote sensing image fusion.
Förderung
- National Natural Science Foundation of China General Program
- Shaanxi Provincial Key Research and Develop Programme General Project
Zitieren
APA
Guo, H., Sun, C., Zhang, J., Zhang, W., & Zhang, N. (2024). MMYFnet: Multi-Modality YOLO Fusion Network for Object Detection in Remote Sensing Images. Remote Sensing, 16(23), 4451. https://doi.org/10.3390/rs16234451
Vancouver
Guo H, Sun C, Zhang J, Zhang W, Zhang N. MMYFnet: Multi-Modality YOLO Fusion Network for Object Detection in Remote Sensing Images. Remote Sensing. 2024;16(23):4451. doi:10.3390/rs16234451
BibTeX
@article{Guo2024,
author = {Guo, Huinan and Sun, Congying and Zhang, Jing and Zhang, Wuxia and Zhang, Nengshuang},
title = {MMYFnet: Multi-Modality YOLO Fusion Network for Object Detection in Remote Sensing Images},
journal = {Remote Sensing},
year = {2024},
volume = {16},
number = {23},
pages = {4451},
doi = {10.3390/rs16234451}
}
EUVIMED