Pedestrian Detection Method Based on Two-Stage Fusion of Visible Light Image and Thermal Infrared Image
Electronics · 21.07.2023 · 12 (14) · 3171
DOI: 10.3390/electronics12143171 ↗Kurz gefasst
Fachartikel in der Zeitschrift Electronics, online erschienen am 21.07.2023. Verfasst von Yugui Zhang und 3 weiteren Autor:innen. Die Arbeit wurde bisher 15-mal zitiert (Crossref) und nennt 44 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Zhejiang Provincial Philosophy and Social Science Foundation of China, Zhejiang Provincial Natural Science Foundation of China, Ningbo Natural Science Foundation.
Abstract (Originalsprache)
Pedestrian detection has important research value and practical significance. It has been used in intelligent monitoring, intelligent transportation, intelligent therapy, and automatic driving. However, in the pixel-level fusion and the feature-level fusion of visible light images and thermal infrared images under shadows during the daytime or under low illumination at night in actual surveillance, missed and false pedestrian detection always occurs. To solve this problem, an algorithm for the pedestrian detection based on the two-stage fusion of visible light images and thermal infrared images is proposed. In this algorithm, in view of the difference and complementarity of visible light images and thermal infrared images, these two types of images are subjected to pixel-level fusion and feature-level fusion according to the varying daytime conditions. In the pixel-level fusion stage, the thermal infrared image, after being brightness enhanced, is fused with the visible image. The obtained pixel-level fusion image contains the information critical for accurate pedestrian detection. In the feature-level fusion stage, in the daytime, the previous pixel-level fusion image is fused with the visible light image; meanwhile, under low illumination at night, the previous pixel-level fusion image is fused with the thermal infrared image. According to the experimental results, the proposed algorithm accurately detects pedestrian under shadows during the daytime and low illumination at night, thereby improving the accuracy of the pedestrian detection and reducing the missed rate and false rate in the detection of pedestrians.
Förderung
- Zhejiang Provincial Philosophy and Social Science Foundation of China
- Zhejiang Provincial Natural Science Foundation of China
- Ningbo Natural Science Foundation
- Ningbo Key R&D Program (Digital Twin Project)
- Natural Science Foundation of the Jiangsu Higher Education Institutions of China
Zitieren
APA
Zhang, Y., Zhai, B., Wang, G., & Lin, J. (2023). Pedestrian Detection Method Based on Two-Stage Fusion of Visible Light Image and Thermal Infrared Image. Electronics, 12(14), 3171. https://doi.org/10.3390/electronics12143171
Vancouver
Zhang Y, Zhai B, Wang G, Lin J. Pedestrian Detection Method Based on Two-Stage Fusion of Visible Light Image and Thermal Infrared Image. Electronics. 2023;12(14):3171. doi:10.3390/electronics12143171
BibTeX
@article{Zhang2023,
author = {Zhang, Yugui and Zhai, Bo and Wang, Gang and Lin, Jianchu},
title = {Pedestrian Detection Method Based on Two-Stage Fusion of Visible Light Image and Thermal Infrared Image},
journal = {Electronics},
year = {2023},
volume = {12},
number = {14},
pages = {3171},
doi = {10.3390/electronics12143171}
}
EUVIMED