Learn to flap: foil non-parametric path planning via deep reinforcement learning
Journal of Fluid Mechanics · 10.04.2024 · 984
DOI: 10.1017/jfm.2023.1096 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Fluid Mechanics, online erschienen am 27.03.2024. Verfasst von Z.P. Wang und 7 weiteren Autor:innen. Die Arbeit wurde bisher 31-mal zitiert (Crossref) und nennt 79 Literaturangaben.
Abstract (Originalsprache)
To optimize flapping foil performance, in the current study we apply deep reinforcement learning (DRL) to plan foil non-parametric motion, as the traditional control techniques and simplified motions cannot fully model nonlinear, unsteady and high-dimensional foil–vortex interactions. Therefore, a DRL training framework is proposed based on the proximal policy optimization algorithm and the transformer architecture, where the policy is initialized from the sinusoidal expert display. We first demonstrate the effectiveness of the proposed DRL-training framework, learning the coherent foil flapping motion to generate thrust. Furthermore, by adjusting reward functions and action thresholds, DRL-optimized foil trajectories can gain significant enhancement in both thrust and efficiency compared with the sinusoidal motion. Last, through visualization of wake morphology and instantaneous pressure distributions, it is found that DRL-optimized foil can adaptively adjust the phases between motion and shedding vortices to improve hydrodynamic performance. Our results give a hint of how to solve complex fluid manipulation problems using the DRL method.
Zitieren
APA
Wang, Z., Lin, R., Zhao, Z., Chen, X., Guo, P., Yang, N., Wang, Z., & Fan, D. (2024). Learn to flap: foil non-parametric path planning via deep reinforcement learning. Journal of Fluid Mechanics, 984. https://doi.org/10.1017/jfm.2023.1096
Vancouver
Wang Z, Lin R, Zhao Z, Chen X, Guo P, Yang N, et al. Learn to flap: foil non-parametric path planning via deep reinforcement learning. Journal of Fluid Mechanics. 2024;984. doi:10.1017/jfm.2023.1096
BibTeX
@article{Wang2024,
author = {Wang, Z.P. and Lin, R.J. and Zhao, Z.Y. and Chen, X. and Guo, P.M. and Yang, N. and Wang, Z.C. and Fan, D.X.},
title = {Learn to flap: foil non-parametric path planning via deep reinforcement learning},
journal = {Journal of Fluid Mechanics},
year = {2024},
volume = {984},
doi = {10.1017/jfm.2023.1096}
}
EUVIMED