Generative Adversarial Immitation Learning for Steering an Unmanned Surface Vehicle
Proceedings of the Northern Lights Deep Learning Workshop · 2020
DOI: 10.7557/18.5147 ↗Kurz gefasst
Fachartikel in der Zeitschrift Proceedings of the Northern Lights Deep Learning Workshop, 2020. Verfasst von Alexandra Vedeler und 1 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref). Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
The task of obstacle avoidance using maritime vessels, such as Unmanned Surface Vehicles (USV), has traditionally been solved using specialized modules that are designed and optimized separately. However, this approach requires a deep insight into the environment, the vessel, and their complex dynamics. We propose an alternative method using Imitation Learning (IL) through Deep Reinforcement Learning (RL) and Deep Inverse Reinforcement Learning (IRL) and present a system that learns an end-to-end steering model capable of mapping radar-like images directly to steering actions in an obstacle avoidance scenario. The USV used in the work is equipped with a Radar sensor and we studied the problem of generating a single action parameter, heading. We apply an IL algorithm known as generative adversarial imitation learning (GAIL) to develop an end-to-end steering model for a scenario where avoidance of an obstacle is the goal. The performance of the system was studied for different design choices and compared to that of a system that is based on pure RL. The IL system produces results that indicate it is able to grasp the concept of the task and that in many ways are on par with the RL system. We deem this to be promising for future use in tasks that are not as easily described by a reward function.
Zitieren
APA
Vedeler, A., & Warakagoda, N. (2020). Generative Adversarial Immitation Learning for Steering an Unmanned Surface Vehicle. Proceedings of the Northern Lights Deep Learning Workshop. https://doi.org/10.7557/18.5147
Vancouver
Vedeler A, Warakagoda N. Generative Adversarial Immitation Learning for Steering an Unmanned Surface Vehicle. Proceedings of the Northern Lights Deep Learning Workshop. 2020. doi:10.7557/18.5147
BibTeX
@article{Vedeler2020,
author = {Vedeler, Alexandra and Warakagoda, Narada},
title = {Generative Adversarial Immitation Learning for Steering an Unmanned Surface Vehicle},
journal = {Proceedings of the Northern Lights Deep Learning Workshop},
year = {2020},
doi = {10.7557/18.5147}
}
EUVIMED