Enhancing UAV Detection in Surveillance Camera Videos through Spatiotemporal Information and Optical Flow
Sensors · 29.06.2023 · 23 (13) · 6037
DOI: 10.3390/s23136037 ↗Kurz gefasst
Fachartikel in der Zeitschrift Sensors, online erschienen am 29.06.2023. Verfasst von Yu Sun und 6 weiteren Autor:innen. Beteiligte Einrichtung: Research Center for Space Optical Engineering, Harbin Institute of Technology, Harbin 150001, China. Die Arbeit wurde bisher 27-mal zitiert (Crossref) und nennt 47 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China.
Abstract (Originalsprache)
The growing intelligence and prevalence of drones have led to an increase in their disorderly and illicit usage, posing substantial risks to aviation and public safety. This paper focuses on addressing the issue of drone detection through surveillance cameras. Drone targets in images possess distinctive characteristics, including small size, weak energy, low contrast, and limited and varying features, rendering precise detection a challenging task. To overcome these challenges, we propose a novel detection method that extends the input of YOLOv5s to a continuous sequence of images and inter-frame optical flow, emulating the visual mechanisms employed by humans. By incorporating the image sequence as input, our model can leverage both temporal and spatial information, extracting more features of small and weak targets through the integration of spatiotemporal data. This integration augments the accuracy and robustness of drone detection. Furthermore, the inclusion of optical flow enables the model to directly perceive the motion information of drone targets across consecutive frames, enhancing its ability to extract and utilize features from dynamic objects. Comparative experiments demonstrate that our proposed method of extended input significantly enhances the network’s capability to detect small moving targets, showcasing competitive performance in terms of accuracy and speed. Specifically, our method achieves a final average precision of 86.87%, representing a noteworthy 11.49% improvement over the baseline, and the speed remains above 30 frames per second. Additionally, our approach is adaptable to other detection models with different backbones, providing valuable insights for domains such as Urban Air Mobility and autonomous driving.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Research Center for Space Optical Engineering, Harbin Institute of Technology, Harbin 150001, China.
ORCID-Profile: Yu Sun, Xiyang Zhi, Tianjun Shi
Förderung
- National Natural Science Foundation of China
Zitieren
APA
Sun, Y., Zhi, X., Han, H., Jiang, S., Shi, T., Gong, J., & Zhang, W. (2023). Enhancing UAV Detection in Surveillance Camera Videos through Spatiotemporal Information and Optical Flow. Sensors, 23(13), 6037. https://doi.org/10.3390/s23136037
Vancouver
Sun Y, Zhi X, Han H, Jiang S, Shi T, Gong J, et al. Enhancing UAV Detection in Surveillance Camera Videos through Spatiotemporal Information and Optical Flow. Sensors. 2023;23(13):6037. doi:10.3390/s23136037
BibTeX
@article{Sun2023,
author = {Sun, Yu and Zhi, Xiyang and Han, Haowen and Jiang, Shikai and Shi, Tianjun and Gong, Jinnan and Zhang, Wei},
title = {Enhancing UAV Detection in Surveillance Camera Videos through Spatiotemporal Information and Optical Flow},
journal = {Sensors},
year = {2023},
volume = {23},
number = {13},
pages = {6037},
doi = {10.3390/s23136037}
}
EUVIMED