Real-Time Object Detection from UAV Inspection Videos by Combining YOLOv5s and DeepStream
Sensors · 14.06.2024 · 24 (12) · 3862
DOI: 10.3390/s24123862 ↗Kurz gefasst
Fachartikel in der Zeitschrift Sensors, online erschienen am 14.06.2024. Verfasst von Shidun Xie und 5 weiteren Autor:innen. Beteiligte Einrichtung: Guangdong Engineering Technology Research Center of UAV Remote Sensing Network, Guangzhou iMapCloud Intelligent Technology Co., Ltd., Guangzhou 51009…. Die Arbeit wurde bisher 17-mal zitiert (Crossref) und nennt 44 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: the GDAS' Project of Science and Technology Development, the Science and Technology Program of Guangdong, The Science and Technology Program of Guangzhou.
Abstract (Originalsprache)
The high-altitude real-time inspection of unmanned aerial vehicles (UAVs) has always been a very challenging task. Because high-altitude inspections are susceptible to interference from different weather conditions, interference from communication signals and a larger field of view result in a smaller object area to be identified. We adopted a method that combines a UAV system scheduling platform with artificial intelligence object detection to implement the UAV automatic inspection technology. We trained the YOLOv5s model on five different categories of vehicle data sets, in which mAP50 and mAP50-95 reached 93.2% and 71.7%, respectively. The YOLOv5s model size is only 13.76 MB, and the detection speed of a single inspection photo reaches 11.26 ms. It is a relatively lightweight model and is suitable for deployment on edge devices for real-time detection. In the original DeepStream framework, we set up the http communication protocol to start quickly to enable different users to call and use it at the same time. In addition, asynchronous sending of alarm frame interception function was added and the auxiliary services were set up to quickly resume video streaming after interruption. We deployed the trained YOLOv5s model on the improved DeepStream framework to implement automatic UAV inspection.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Guangdong Engineering Technology Research Center of UAV Remote Sensing Network, Guangzhou iMapCloud Intelligent Technology Co., Ltd., Guangzhou 510095, China.
- Guangdong Province Engineering Laboratory for Geographic Spatiotemporal Big Data, Key Laboratory of Guangdong for Utilization of Remote Sensing and Geographical Information System, Guangdong Open Laboratory of Geospatia…
ORCID-Profile: Wenlong Jing
Förderung
- the GDAS' Project of Science and Technology Development
- the Science and Technology Program of Guangdong
- The Science and Technology Program of Guangzhou
- The Science and Technology Innovation Program of Foshan
- The National Key Research and Development Program of China
- GDAS’ Project of Science and Technology Development
- National Key R&D Program of China
- National Natural Science Foundation of China
Zitieren
APA
Xie, S., Deng, G., Lin, B., Jing, W., Li, Y., & Zhao, X. (2024). Real-Time Object Detection from UAV Inspection Videos by Combining YOLOv5s and DeepStream. Sensors, 24(12), 3862. https://doi.org/10.3390/s24123862
Vancouver
Xie S, Deng G, Lin B, Jing W, Li Y, Zhao X. Real-Time Object Detection from UAV Inspection Videos by Combining YOLOv5s and DeepStream. Sensors. 2024;24(12):3862. doi:10.3390/s24123862
BibTeX
@article{Xie2024,
author = {Xie, Shidun and Deng, Guanghong and Lin, Baihao and Jing, Wenlong and Li, Yong and Zhao, Xiaodan},
title = {Real-Time Object Detection from UAV Inspection Videos by Combining YOLOv5s and DeepStream},
journal = {Sensors},
year = {2024},
volume = {24},
number = {12},
pages = {3862},
doi = {10.3390/s24123862}
}
EUVIMED