Deep Reinforcement Learning Methods for Suppressing Horizontal Sway of Construction Cranes in Virtual Physical Environment
Journal of Construction Automation and Robotics · 2022
DOI: 10.55785/jcar.1.2.19 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Construction Automation and Robotics, 2022. Verfasst von In Won Kim und 4 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 20 Literaturangaben.
Abstract (Originalsprache)
In the development of a deep reinforcement learning-based autonomous operation model of cranes, the control of heavy object’s horizontal sway is an important issue that directly affects crane operation safety. In kinematics, however, the motion control of a heavy object with pendulum motion is classified as an underactuated system in which the degree of freedom of movement of objects is larger than the number of manipulable actions of controllers. This increases the variance of rewards expected from action and state samples in reinforcement learning, and raises the problem of sample efficiency, which means the number of samples effective for learning. Therefore, this study analyzes the sample efficiency that occurs when learning the reinforcement learning model for sway control of cranes using Proximal Policy Optimization and Generative Adversarial Imitation Learning (GAIL) techniques. To this end, this study established a virtual physical environment capable of simulating the movement of a construction crane, and expert demonstration data samples were collected for GAIL. Finally, the effect of PPO and GAIL on sample efficiency was analyzed through the experiment. The results show that the reinforcement learning technique applied to the experiment is effective in improving the sample efficiency and learning performance of the crane model.
Zitieren
APA
Kim, I. W., Kim, N. K., Jung, M. H., Ahn, C. B., & Park, M. S. (2022). Deep Reinforcement Learning Methods for Suppressing Horizontal Sway of Construction Cranes in Virtual Physical Environment. Journal of Construction Automation and Robotics. https://doi.org/10.55785/jcar.1.2.19
Vancouver
Kim IW, Kim NK, Jung MH, Ahn CB, Park MS. Deep Reinforcement Learning Methods for Suppressing Horizontal Sway of Construction Cranes in Virtual Physical Environment. Journal of Construction Automation and Robotics. 2022. doi:10.55785/jcar.1.2.19
BibTeX
@article{Kim2022,
author = {Kim, In Won and Kim, Nam Kyoun and Jung, Min Hyuk and Ahn, Chang Bum and Park, Moon Seo},
title = {Deep Reinforcement Learning Methods for Suppressing Horizontal Sway of Construction Cranes in Virtual Physical Environment},
journal = {Journal of Construction Automation and Robotics},
year = {2022},
doi = {10.55785/jcar.1.2.19}
}
EUVIMED