EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Drone Elevation Control Based on Python-Unity Integrated Framework for Reinforcement Learning Applications

Mahmoud Abdelkader Bashery Abbass, Hyun-Soo Kang

Drones · 24.03.2023 · 7 (4) · 225

DOI: 10.3390/drones7040225 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Drones, online erschienen am 24.03.2023. Verfasst von Mahmoud Abdelkader Bashery Abbass und 1 weiteren Autor:innen. Die Arbeit wurde bisher 20-mal zitiert (Crossref) und nennt 91 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: MSIT (Ministry of Science and ICT), the Grand Information Technology Research Center support program, the IITP (Institute for Information & communications Technology Planning & Evaluation).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Reinforcement learning (RL) applications require a huge effort to become established in real-world environments, due to the injury and break down risks during interactions between the RL agent and the environment, in the online training process. In addition, the RL platform tools (e.g., Python OpenAI’s Gym, Unity ML-Agents, PyBullet, DART, MoJoCo, RaiSim, Isaac, and AirSim), that are required to reduce the real-world challenges, suffer from drawbacks (e.g., the limited number of examples and applications, and difficulties in implementation of the RL algorithms, due to difficulties with the programing language). This paper presents an integrated RL framework, based on Python–Unity interaction, to demonstrate the ability to create a new RL platform tool, based on making a stable user datagram protocol (UDP) communication between the RL agent algorithm (developed using the Python programing language as a server), and the simulation environment (created using the Unity simulation software as a client). This Python–Unity integration process, increases the advantage of the overall RL platform (i.e., flexibility, scalability, and robustness), with the ability to create different environment specifications. The challenge of RL algorithms’ implementation and development is also achieved. The proposed framework is validated by applying two popular deep RL algorithms (i.e., Vanilla Policy Gradient (VPG) and Actor-Critic (A2C)), on an elevation control challenge for a quadcopter drone. The validation results for these experimental tests, prove the innovation of the proposed framework, to be used in RL applications, because both implemented algorithms achieve high stability, by achieving convergence to the required performance through the semi-online training process.

Förderung

  • MSIT (Ministry of Science and ICT)
  • the Grand Information Technology Research Center support program
  • the IITP (Institute for Information & communications Technology Planning & Evaluation)

Zitieren

APA

Abbass, M. A. B., & Kang, H. (2023). Drone Elevation Control Based on Python-Unity Integrated Framework for Reinforcement Learning Applications. Drones, 7(4), 225. https://doi.org/10.3390/drones7040225

Vancouver

Abbass MAB, Kang H. Drone Elevation Control Based on Python-Unity Integrated Framework for Reinforcement Learning Applications. Drones. 2023;7(4):225. doi:10.3390/drones7040225

BibTeX
@article{Abbass2023,
  author = {Abbass, Mahmoud Abdelkader Bashery and Kang, Hyun-Soo},
  title = {Drone Elevation Control Based on Python-Unity Integrated Framework for Reinforcement Learning Applications},
  journal = {Drones},
  year = {2023},
  volume = {7},
  number = {4},
  pages = {225},
  doi = {10.3390/drones7040225}
}
Kostenlos starten →