EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Simulation of Coherent Excavator Operations in Earthmoving Tasks Based on Reinforcement Learning

Yongyue Liu, Yaowu Wang, Zhenzong Zhou

Buildings · 15.10.2024 · 14 (10) · 3270

DOI: 10.3390/buildings14103270 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Buildings, online erschienen am 15.10.2024. Verfasst von Yongyue Liu und 2 weiteren Autor:innen. Die Arbeit wurde bisher 6-mal zitiert (Crossref) und nennt 35 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Earthwork operations are critical to construction projects, with their safety and efficiency influenced by factors such as operator skill and working hours. Pre-construction simulation of these operations is essential for optimizing outcomes, providing key training for operators and improving safety awareness and operational efficiency. This study introduces a hierarchical cumulative reward mechanism that decomposes complex operational behaviors into simple, fundamental actions. The mechanism prioritizes reward function design elements, including order, size, and form, thus simplifying excavator operation simulation using reinforcement learning (RL) and enhancing policy network reusability. A 3D model of a hydraulic excavator was constructed with six degrees of freedom—comprising the boom, arm, bucket, base, and left/right tracks. The Proximal Policy Optimization (PPO) algorithm was applied to train four basic behaviors: scraping, digging, throwing, and turning back. Motion simulation was successfully achieved using diggable terrain resources. Results demonstrate that the simulated excavator, powered by RL neural networks, can perform coordinated actions and maintain smooth operational performance. This research offers practical implications by rapidly illustrating the full operational process before construction, delivering immersive movies, and enhancing worker safety and operational efficiency.

Zitieren

APA

Liu, Y., Wang, Y., & Zhou, Z. (2024). Simulation of Coherent Excavator Operations in Earthmoving Tasks Based on Reinforcement Learning. Buildings, 14(10), 3270. https://doi.org/10.3390/buildings14103270

Vancouver

Liu Y, Wang Y, Zhou Z. Simulation of Coherent Excavator Operations in Earthmoving Tasks Based on Reinforcement Learning. Buildings. 2024;14(10):3270. doi:10.3390/buildings14103270

BibTeX
@article{Liu2024,
  author = {Liu, Yongyue and Wang, Yaowu and Zhou, Zhenzong},
  title = {Simulation of Coherent Excavator Operations in Earthmoving Tasks Based on Reinforcement Learning},
  journal = {Buildings},
  year = {2024},
  volume = {14},
  number = {10},
  pages = {3270},
  doi = {10.3390/buildings14103270}
}
Kostenlos starten →