Reinforcement Learning for Efficient Design Space Exploration With Variable Fidelity Analysis Models
Journal of Computing and Information Science in Engineering · 01.08.2023 · 23 (4)
DOI: 10.1115/1.4056297 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Computing and Information Science in Engineering, online erschienen am 09.01.2023. Verfasst von Akash Agrawal und 1 weiteren Autor:innen. Die Arbeit wurde bisher 15-mal zitiert (Crossref) und nennt 49 Literaturangaben. Gefördert von: Defense Advanced Research Projects Agency.
Abstract (Originalsprache)
Reinforcement learning algorithms can autonomously learn to search a design space for high-performance solutions. However, modern engineering often entails the use of computationally intensive simulation, which can lead to slower design timelines with highly iterative approaches such as reinforcement learning. This work provides a reinforcement learning framework that leverages models of varying fidelity to enable an effective solution search while reducing overall computational needs. Specifically, it utilizes models of varying fidelity while training the agent, iteratively progressing from low- to high fidelity. To demonstrate the effectiveness of the proposed framework, we apply it to two multimodal multi-objective constrained mixed integer nonlinear design problems involving the components of a ground and aerial vehicle. Specifically, for each problem, we utilize a high-fidelity and a low-fidelity deep neural network surrogate model, trained on performance data generated from underlying ground truth models. A tradeoff between solution quality and the proportion of low-fidelity surrogate model usage is observed. Specifically, high-quality solutions are achieved with substantial reductions in computational expense, showcasing the effectiveness of the framework for design problems where the use of just a high-fidelity model is infeasible. This solution quality-computational efficiency tradeoff is contextualized by visualizing the exploration behavior of the design agents.
Förderung
- Defense Advanced Research Projects Agency
Zitieren
APA
Agrawal, A., & McComb, C. (2023). Reinforcement Learning for Efficient Design Space Exploration With Variable Fidelity Analysis Models. Journal of Computing and Information Science in Engineering, 23(4). https://doi.org/10.1115/1.4056297
Vancouver
Agrawal A, McComb C. Reinforcement Learning for Efficient Design Space Exploration With Variable Fidelity Analysis Models. Journal of Computing and Information Science in Engineering. 2023;23(4). doi:10.1115/1.4056297
BibTeX
@article{Agrawal2023,
author = {Agrawal, Akash and McComb, Christopher},
title = {Reinforcement Learning for Efficient Design Space Exploration With Variable Fidelity Analysis Models},
journal = {Journal of Computing and Information Science in Engineering},
year = {2023},
volume = {23},
number = {4},
doi = {10.1115/1.4056297}
}
EUVIMED