Deep Reinforcement Learning for the Visual Servoing Control of UAVs with FOV Constraint
Drones · 03.06.2023 · 7 (6) · 375
DOI: 10.3390/drones7060375 ↗Kurz gefasst
Fachartikel in der Zeitschrift Drones, online erschienen am 03.06.2023. Verfasst von Gui Fu und 4 weiteren Autor:innen. Die Arbeit wurde bisher 22-mal zitiert (Crossref) und nennt 29 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China, Fund project for basic scientific research expenses of central universities, Independent research project of the Key Laboratory of Flight Techniques and Flight Safety.
Abstract (Originalsprache)
Visual servoing is a control method that utilizes image feedback to control robot motion, and it has been widely applied in unmanned aerial vehicle (UAV) motion control. However, due to field-of-view (FOV) constraints, visual servoing still faces challenges, such as easy target loss and low control efficiency. To address these issues, visual servoing control for UAVs based on the deep reinforcement learning (DRL) method is proposed, which dynamically adjusts the servo gain in real time to avoid target loss and improve control efficiency. Firstly, a Markov model of visual servoing control for a UAV under field-of-view constraints is established, which consists ofquintuplet and considers the improvement of the control efficiency. Secondly, an improved deep Q-network (DQN) algorithm with a target network and experience replay is designed to solve the Markov model. In addition, two independent agents are designed to adjust the linear and angular velocity servo gains in order to enhance the control performance, respectively. In the simulation environment, the effectiveness of the proposed method was verified using a monocular camera.
Förderung
- National Natural Science Foundation of China
- Fund project for basic scientific research expenses of central universities
- Independent research project of the Key Laboratory of Flight Techniques and Flight Safety
Zitieren
APA
Fu, G., Chu, H., Liu, L., Fang, L., & Zhu, X. (2023). Deep Reinforcement Learning for the Visual Servoing Control of UAVs with FOV Constraint. Drones, 7(6), 375. https://doi.org/10.3390/drones7060375
Vancouver
Fu G, Chu H, Liu L, Fang L, Zhu X. Deep Reinforcement Learning for the Visual Servoing Control of UAVs with FOV Constraint. Drones. 2023;7(6):375. doi:10.3390/drones7060375
BibTeX
@article{Fu2023,
author = {Fu, Gui and Chu, Hongyu and Liu, Liwen and Fang, Linyi and Zhu, Xinyu},
title = {Deep Reinforcement Learning for the Visual Servoing Control of UAVs with FOV Constraint},
journal = {Drones},
year = {2023},
volume = {7},
number = {6},
pages = {375},
doi = {10.3390/drones7060375}
}
EUVIMED