EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

MMYFnet: Multi-Modality YOLO Fusion Network for Object Detection in Remote Sensing Images

Huinan Guo, Congying Sun, Jing Zhang, Wuxia Zhang, Nengshuang Zhang

Remote Sensing · 27.11.2024 · 16 (23) · 4451

DOI: 10.3390/rs16234451 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Remote Sensing, online erschienen am 27.11.2024. Verfasst von Huinan Guo und 4 weiteren Autor:innen. Die Arbeit wurde bisher 25-mal zitiert (Crossref) und nennt 56 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China General Program, Shaanxi Provincial Key Research and Develop Programme General Project.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Object detection in remote sensing images is crucial for airport management, hazard prevention, traffic monitoring, and more. The precise ability for object localization and identification enables remote sensing imagery to provide early warnings, mitigate risks, and offer strong support for decision-making processes. While traditional deep learning-based object detection techniques have achieved significant results in single-modal environments, their detection capabilities still encounter challenges when confronted with complex environments, such as adverse weather conditions or situations where objects are obscured. To overcome the limitations of existing fusion methods in terms of complexity and insufficient information utilization, we innovatively propose a Cosine Similarity-based Image Feature Fusion (CSIFF) module and integrate it into a dual-branch YOLOv8 network, constructing a lightweight and efficient target detection network called Multi-Modality YOLO Fusion Network (MMYFNet). This network utilizes cosine similarity to divide the original features into common features and specific features, which are then refined and fused through specific modules. Experimental and analytical results show that MMYFNet performs excellently on both the VEDAI and FLIR datasets, achieving mAP values of 80% and 76.8%, respectively. Further validation through parameter sensitivity experiments, ablation studies, and visual analyses confirms the effectiveness of the CSIFF module. MMYFNet achieves high detection accuracy with fewer parameters, and the CSIFF module, as a plug-and-play module, can be integrated into other CNN-based cross-modality network models, providing a new approach for object detection in remote sensing image fusion.

Förderung

  • National Natural Science Foundation of China General Program
  • Shaanxi Provincial Key Research and Develop Programme General Project

Zitieren

APA

Guo, H., Sun, C., Zhang, J., Zhang, W., & Zhang, N. (2024). MMYFnet: Multi-Modality YOLO Fusion Network for Object Detection in Remote Sensing Images. Remote Sensing, 16(23), 4451. https://doi.org/10.3390/rs16234451

Vancouver

Guo H, Sun C, Zhang J, Zhang W, Zhang N. MMYFnet: Multi-Modality YOLO Fusion Network for Object Detection in Remote Sensing Images. Remote Sensing. 2024;16(23):4451. doi:10.3390/rs16234451

BibTeX
@article{Guo2024,
  author = {Guo, Huinan and Sun, Congying and Zhang, Jing and Zhang, Wuxia and Zhang, Nengshuang},
  title = {MMYFnet: Multi-Modality YOLO Fusion Network for Object Detection in Remote Sensing Images},
  journal = {Remote Sensing},
  year = {2024},
  volume = {16},
  number = {23},
  pages = {4451},
  doi = {10.3390/rs16234451}
}
Kostenlos starten →