EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Real-Time Object Detection from UAV Inspection Videos by Combining YOLOv5s and DeepStream

Shidun Xie, Guanghong Deng, Baihao Lin, Wenlong Jing iD, Yong Li, Xiaodan Zhao

Sensors · 14.06.2024 · 24 (12) · 3862

DOI: 10.3390/s24123862 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Sensors, online erschienen am 14.06.2024. Verfasst von Shidun Xie und 5 weiteren Autor:innen. Beteiligte Einrichtung: Guangdong Engineering Technology Research Center of UAV Remote Sensing Network, Guangzhou iMapCloud Intelligent Technology Co., Ltd., Guangzhou 51009…. Die Arbeit wurde bisher 17-mal zitiert (Crossref) und nennt 44 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: the GDAS' Project of Science and Technology Development, the Science and Technology Program of Guangdong, The Science and Technology Program of Guangzhou.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The high-altitude real-time inspection of unmanned aerial vehicles (UAVs) has always been a very challenging task. Because high-altitude inspections are susceptible to interference from different weather conditions, interference from communication signals and a larger field of view result in a smaller object area to be identified. We adopted a method that combines a UAV system scheduling platform with artificial intelligence object detection to implement the UAV automatic inspection technology. We trained the YOLOv5s model on five different categories of vehicle data sets, in which mAP50 and mAP50-95 reached 93.2% and 71.7%, respectively. The YOLOv5s model size is only 13.76 MB, and the detection speed of a single inspection photo reaches 11.26 ms. It is a relatively lightweight model and is suitable for deployment on edge devices for real-time detection. In the original DeepStream framework, we set up the http communication protocol to start quickly to enable different users to call and use it at the same time. In addition, asynchronous sending of alarm frame interception function was added and the auxiliary services were set up to quickly resume video streaming after interruption. We deployed the trained YOLOv5s model on the improved DeepStream framework to implement automatic UAV inspection.

Schlagwörter

Stichwörter der Autor:innen

DeepStreamUAVsYOLOv5object detectionroute planning

Autor:innen und Institutionen

  • Guangdong Engineering Technology Research Center of UAV Remote Sensing Network, Guangzhou iMapCloud Intelligent Technology Co., Ltd., Guangzhou 510095, China.
  • Guangdong Province Engineering Laboratory for Geographic Spatiotemporal Big Data, Key Laboratory of Guangdong for Utilization of Remote Sensing and Geographical Information System, Guangdong Open Laboratory of Geospatia…

ORCID-Profile: Wenlong Jing

Förderung

  • the GDAS' Project of Science and Technology Development
  • the Science and Technology Program of Guangdong
  • The Science and Technology Program of Guangzhou
  • The Science and Technology Innovation Program of Foshan
  • The National Key Research and Development Program of China
  • GDAS’ Project of Science and Technology Development
  • National Key R&D Program of China
  • National Natural Science Foundation of China

Zitieren

APA

Xie, S., Deng, G., Lin, B., Jing, W., Li, Y., & Zhao, X. (2024). Real-Time Object Detection from UAV Inspection Videos by Combining YOLOv5s and DeepStream. Sensors, 24(12), 3862. https://doi.org/10.3390/s24123862

Vancouver

Xie S, Deng G, Lin B, Jing W, Li Y, Zhao X. Real-Time Object Detection from UAV Inspection Videos by Combining YOLOv5s and DeepStream. Sensors. 2024;24(12):3862. doi:10.3390/s24123862

BibTeX
@article{Xie2024,
  author = {Xie, Shidun and Deng, Guanghong and Lin, Baihao and Jing, Wenlong and Li, Yong and Zhao, Xiaodan},
  title = {Real-Time Object Detection from UAV Inspection Videos by Combining YOLOv5s and DeepStream},
  journal = {Sensors},
  year = {2024},
  volume = {24},
  number = {12},
  pages = {3862},
  doi = {10.3390/s24123862}
}
Kostenlos starten →