FPGA-Based CNN for Real-Time UAV Tracking and Detection
Frontiers in Space Technologies · 25.05.2022 · 3
DOI: 10.3389/frspt.2022.878010 ↗Kurz gefasst
Fachartikel in der Zeitschrift Frontiers in Space Technologies, online erschienen am 25.05.2022. Verfasst von Peter Hobden und 2 weiteren Autor:innen. Die Arbeit wurde bisher 15-mal zitiert (Crossref) und nennt 25 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Neural networks (NNs) are now being extensively utilized in various artificial intelligence platforms specifically in the area of image classification and real-time object tracking. We propose a novel design to address the problem of real-time unmanned aerial vehicle (UAV) monitoring and detection using a Zynq UltraScale FPGA-based convolutional neural network (CNN). The biggest challenge while implementing real-time algorithms on FPGAs is the limited DSP hardware resources available on FPGA platforms. Our proposed design overcomes the challenge of autonomous real-time UAV detection and tracking using a Xilinx’s Zynq UltraScale XCZU9EG system on a chip (SoC) platform. Our proposed design explores and provides a solution for overcoming the challenge of limited floating-point resources while maintaining real-time performance. The solution consists of two modules: UAV tracking module and neural network–based UAV detection module. The tracking module uses our novel background-differencing algorithm, while the UAV detection is based on a modified CNN algorithm, designed to give the maximum field-programmable gate array (FPGA) performance. These two modules are designed to complement each other and enabled simultaneously to provide an enhanced real-time UAV detection for any given video input. The proposed system has been tested on real-life flying UAVs, achieving an accuracy of 82%, running at the full frame rate of the input camera for both tracking and neural network (NN) detection, achieving similar performance than an equivalent deep learning processor unit (DPU) with UltraScale FPGA-based HD video and tracking implementation but with lower resource utilization as shown by our results.
Zitieren
APA
Hobden, P., Srivastava, S., & Nurellari, E. (2022). FPGA-Based CNN for Real-Time UAV Tracking and Detection. Frontiers in Space Technologies, 3. https://doi.org/10.3389/frspt.2022.878010
Vancouver
Hobden P, Srivastava S, Nurellari E. FPGA-Based CNN for Real-Time UAV Tracking and Detection. Frontiers in Space Technologies. 2022;3. doi:10.3389/frspt.2022.878010
BibTeX
@article{Hobden2022,
author = {Hobden, Peter and Srivastava, Saket and Nurellari, Edmond},
title = {FPGA-Based CNN for Real-Time UAV Tracking and Detection},
journal = {Frontiers in Space Technologies},
year = {2022},
volume = {3},
doi = {10.3389/frspt.2022.878010}
}
EUVIMED