EUVIMEDEUVIMED entdecken
Crossref

Reinforcement Learning for Efficient Design Space Exploration With Variable Fidelity Analysis Models

Akash Agrawal, Christopher McComb

Journal of Computing and Information Science in Engineering · 01.08.2023 · 23 (4)

DOI: 10.1115/1.4056297 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Computing and Information Science in Engineering, online erschienen am 09.01.2023. Verfasst von Akash Agrawal und 1 weiteren Autor:innen. Die Arbeit wurde bisher 15-mal zitiert (Crossref) und nennt 49 Literaturangaben. Gefördert von: Defense Advanced Research Projects Agency.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Reinforcement learning algorithms can autonomously learn to search a design space for high-performance solutions. However, modern engineering often entails the use of computationally intensive simulation, which can lead to slower design timelines with highly iterative approaches such as reinforcement learning. This work provides a reinforcement learning framework that leverages models of varying fidelity to enable an effective solution search while reducing overall computational needs. Specifically, it utilizes models of varying fidelity while training the agent, iteratively progressing from low- to high fidelity. To demonstrate the effectiveness of the proposed framework, we apply it to two multimodal multi-objective constrained mixed integer nonlinear design problems involving the components of a ground and aerial vehicle. Specifically, for each problem, we utilize a high-fidelity and a low-fidelity deep neural network surrogate model, trained on performance data generated from underlying ground truth models. A tradeoff between solution quality and the proportion of low-fidelity surrogate model usage is observed. Specifically, high-quality solutions are achieved with substantial reductions in computational expense, showcasing the effectiveness of the framework for design problems where the use of just a high-fidelity model is infeasible. This solution quality-computational efficiency tradeoff is contextualized by visualizing the exploration behavior of the design agents.

Förderung

  • Defense Advanced Research Projects Agency

Zitieren

APA

Agrawal, A., & McComb, C. (2023). Reinforcement Learning for Efficient Design Space Exploration With Variable Fidelity Analysis Models. Journal of Computing and Information Science in Engineering, 23(4). https://doi.org/10.1115/1.4056297

Vancouver

Agrawal A, McComb C. Reinforcement Learning for Efficient Design Space Exploration With Variable Fidelity Analysis Models. Journal of Computing and Information Science in Engineering. 2023;23(4). doi:10.1115/1.4056297

BibTeX
@article{Agrawal2023,
  author = {Agrawal, Akash and McComb, Christopher},
  title = {Reinforcement Learning for Efficient Design Space Exploration With Variable Fidelity Analysis Models},
  journal = {Journal of Computing and Information Science in Engineering},
  year = {2023},
  volume = {23},
  number = {4},
  doi = {10.1115/1.4056297}
}
Kostenlos starten →