Deep excavation wall design using reinforcement learning
Archives of Civil Engineering · 30.06.2026 · 72 (2) · 93-107
DOI: 10.24425/ace.2026.158596 ↗Kurz gefasst
Fachartikel in der Zeitschrift Archives of Civil Engineering, online erschienen am 30.06.2026. Verfasst von Maksym Beichuk und 2 weiteren Autor:innen. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0).
Abstract (Originalsprache)
This study investigates the application of reinforcement learning (RL) for obtaining near-optimal designs of diaphragm walls in geotechnical engineering. A physics-based numerical environment is developed to simulate soil–structure interaction, relying on a Winkler spring formulation with pressure-dependent soil springs to approximate the nonlinear response of the ground. This modelling framework allows the agent to evaluate candidate designs through physically meaningful structural responses rather than surrogate performance indicators. To reflect realistic engineering practice, a specifically designed action space and reward function are formulated, incorporating both discrete design decisions and continuous geometric parameters. During training, the agent iteratively proposes a design configuration, observes the response computed by the physical simulator, and updates its policy based on the resulting reward signal. Several common RL algorithms are investigated, including Proximal Policy Optimization (PPO), REINFORCE, and the Parameterized Deep Q-Network (P-DQN), enabling a comparative assessment of policy-based and hybrid value based approaches for this task. The algorithms are evaluated in terms of learning stability, convergence behaviour, and the quality of the resulting design solutions. The results demonstrate the potential of RL-based methods to explore complex design spaces efficiently while respecting physical constraints, highlighting their suitability for supporting automated or decision-assisted design of diaphragm walls.
Zitieren
APA
Beichuk, M., Zdor, K., & Mitew-Czajewska, M. (2026). Deep excavation wall design using reinforcement learning. Archives of Civil Engineering, 72(2), 93-107. https://doi.org/10.24425/ace.2026.158596
Vancouver
Beichuk M, Zdor K, Mitew-Czajewska M. Deep excavation wall design using reinforcement learning. Archives of Civil Engineering. 2026;72(2):93-107. doi:10.24425/ace.2026.158596
BibTeX
@article{Beichuk2026,
author = {Beichuk, Maksym and Zdor, Kostiantyn and Mitew-Czajewska, Monika},
title = {Deep excavation wall design using reinforcement learning},
journal = {Archives of Civil Engineering},
year = {2026},
volume = {72},
number = {2},
pages = {93--107},
doi = {10.24425/ace.2026.158596}
}
EUVIMED