Dual-YOLO Architecture from Infrared and Visible Images for Object Detection
Sensors · 08.03.2023 · 23 (6) · 2934
DOI: 10.3390/s23062934 ↗Kurz gefasst
Fachartikel in der Zeitschrift Sensors, online erschienen am 08.03.2023. Verfasst von Chun Bao und 5 weiteren Autor:innen. Beteiligte Einrichtung: Bionic Robot Key Laboratory of Ministry of Education, School of Optics and Photonics, Beijing Institute of Technology, Beijing 100081, China. Die Arbeit wurde bisher 125-mal zitiert (Crossref) und nennt 43 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China, Beijing Municipal Natural Science Foundation, the funding of foundation enhancement program.
Abstract (Originalsprache)
With the development of infrared detection technology and the improvement of military remote sensing needs, infrared object detection networks with low false alarms and high detection accuracy have been a research focus. However, due to the lack of texture information, the false detection rate of infrared object detection is high, resulting in reduced object detection accuracy. To solve these problems, we propose an infrared object detection network named Dual-YOLO, which integrates visible image features. To ensure the speed of model detection, we choose the You Only Look Once v7 (YOLOv7) as the basic framework and design the infrared and visible images dual feature extraction channels. In addition, we develop attention fusion and fusion shuffle modules to reduce the detection error caused by redundant fusion feature information. Moreover, we introduce the Inception and SE modules to enhance the complementary characteristics of infrared and visible images. Furthermore, we design the fusion loss function to make the network converge fast during training. The experimental results show that the proposed Dual-YOLO network reaches 71.8% mean Average Precision (mAP) in the DroneVehicle remote sensing dataset and 73.2% mAP in the KAIST pedestrian dataset. The detection accuracy reaches 84.5% in the FLIR dataset. The proposed architecture is expected to be applied in the fields of military reconnaissance, unmanned driving, and public safety.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Bionic Robot Key Laboratory of Ministry of Education, School of Optics and Photonics, Beijing Institute of Technology, Beijing 100081, China.
- Yangtze Delta Region Academy, Beijing Institute of Technology, Jiaxing 314003, China.
- School of Opto-Electronic Engineering, Changchun University of Science and Technology, Changchun 130022, China.
ORCID-Profile: Chun Bao, Yang Cheng
Förderung
- National Natural Science Foundation of China
- Beijing Municipal Natural Science Foundation
- the funding of foundation enhancement program
- funding of foundation enhancement program
Zitieren
APA
Bao, C., Cao, J., Hao, Q., Cheng, Y., Ning, Y., & Zhao, T. (2023). Dual-YOLO Architecture from Infrared and Visible Images for Object Detection. Sensors, 23(6), 2934. https://doi.org/10.3390/s23062934
Vancouver
Bao C, Cao J, Hao Q, Cheng Y, Ning Y, Zhao T. Dual-YOLO Architecture from Infrared and Visible Images for Object Detection. Sensors. 2023;23(6):2934. doi:10.3390/s23062934
BibTeX
@article{Bao2023,
author = {Bao, Chun and Cao, Jie and Hao, Qun and Cheng, Yang and Ning, Yaqian and Zhao, Tianhua},
title = {Dual-YOLO Architecture from Infrared and Visible Images for Object Detection},
journal = {Sensors},
year = {2023},
volume = {23},
number = {6},
pages = {2934},
doi = {10.3390/s23062934}
}
EUVIMED