Dynamic programming approach for one linear quadratic optimal control problem with uncertainty
Journal of Numerical and Applied Mathematics · 2026 · (1) · 13-32
DOI: 10.17721/2706-9699.2026.1.02 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Numerical and Applied Mathematics, 2026. Verfasst von A. V. Makarovych und 1 weiteren Autor:innen. Die Arbeit nennt 13 Literaturangaben.
Abstract (Originalsprache)
This article focuses on solving the linear-quadratic (LQ) optimal control problem for a parabolic partial differential equation (PDE) operating under parametric uncertainty. To manage this uncertainty, we model the unknown parameter via a probability distribution and minimize the expected value of the cost functional. Applying a Dynamic Programming approach to this system yields an exact optimal state-feedback control law, which is governed by a infinite-dimensional Integro-Differential Riccati Equation (IDRE). Because solving this equation directly is computationally prohibitive, we employ a Spectral Galerkin method combined with a polynomial chaos expansion to approximate the stochastic parameter space. This mathematical transformation reduces the complex, stochastic IDRE into a standard Matrix Riccati Differential Equation (MRDE). By reducing the stochastic PDE control problem to an MRDE that can be solved in advance, our framework avoids the severe computational bottlenecks typically associated with uncertain environments. This provides a highly efficient baseline for robust controller design and future reinforcement learning implementations.
Zitieren
APA
Makarovych, A. V., & Kapustian, O. A. (2026). Dynamic programming approach for one linear quadratic optimal control problem with uncertainty. Journal of Numerical and Applied Mathematics, 13-32. https://doi.org/10.17721/2706-9699.2026.1.02
Vancouver
Makarovych AV, Kapustian OA. Dynamic programming approach for one linear quadratic optimal control problem with uncertainty. Journal of Numerical and Applied Mathematics. 2026:13-32. doi:10.17721/2706-9699.2026.1.02
BibTeX
@article{Makarovych2026,
author = {Makarovych, A. V. and Kapustian, O. A.},
title = {Dynamic programming approach for one linear quadratic optimal control problem with uncertainty},
journal = {Journal of Numerical and Applied Mathematics},
year = {2026},
number = {1},
pages = {13--32},
doi = {10.17721/2706-9699.2026.1.02}
}
EUVIMED