Design Synthesis of Structural Systems as a Markov Decision Process Solved With Deep Reinforcement Learning
Journal of Mechanical Design · 01.06.2023 · 145 (6)
DOI: 10.1115/1.4056693 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Mechanical Design, online erschienen am 10.02.2023. Verfasst von Maximilian E. Ororbia und 1 weiteren Autor:innen. Die Arbeit wurde bisher 22-mal zitiert (Crossref) und nennt 54 Literaturangaben. Gefördert von: Pennsylvania State University.
Abstract (Originalsprache)
Recently, it was demonstrated that the design synthesis of truss structures can be modeled as a Markov decision process (MDP) and solved using a tabular reinforcement learning method. In this setting, each state corresponds to a specific design configuration represented as a finite graph. However, when the structural design domain is relatively large, and depending on the constraints, the dimensionality of the state space becomes quite large rendering tabular reinforcement learning algorithms inefficient. Hence, in this study, the design synthesis MDP framework is significantly extended to solve structural design problems with large state spaces, by integrating deep reinforcement learning (DRL) into the general MDP framework. This is beneficial because with DRL, a deep neural network can be used to approximate the state-action value function, such that the network has much fewer parameters than the cardinality of the state space. This parameterization relies upon a problem relevant set of features and reward function. Thus, for this extended DRL design synthesis (DRLDS) framework, a compact set of features and a reward function are devised that are suitable for structural design problems where structural configurations are represented as finite graphs. Through the application of seven different structural design synthesis examples, the DRLDS framework is demonstrated to be capable of adeptly learning optimal policies that synthesize high, if not the highest, performing design solutions more frequently. The DRLDS framework does this with fewer finite element model evaluations than other considered alternative methods, further demonstrating the effectiveness of the developed set of features and reward function.
Förderung
- Pennsylvania State University
Zitieren
APA
Ororbia, M. E., & Warn, G. P. (2023). Design Synthesis of Structural Systems as a Markov Decision Process Solved With Deep Reinforcement Learning. Journal of Mechanical Design, 145(6). https://doi.org/10.1115/1.4056693
Vancouver
Ororbia ME, Warn GP. Design Synthesis of Structural Systems as a Markov Decision Process Solved With Deep Reinforcement Learning. Journal of Mechanical Design. 2023;145(6). doi:10.1115/1.4056693
BibTeX
@article{Ororbia2023,
author = {Ororbia, Maximilian E. and Warn, Gordon P.},
title = {Design Synthesis of Structural Systems as a Markov Decision Process Solved With Deep Reinforcement Learning},
journal = {Journal of Mechanical Design},
year = {2023},
volume = {145},
number = {6},
doi = {10.1115/1.4056693}
}
EUVIMED