Parsimonious physics-informed random projection neural networks for initial value problems of ODEs and index-1 DAEs
Chaos: An Interdisciplinary Journal of Nonlinear Science · 01.04.2023 · 33 (4)
DOI: 10.1063/5.0135903 ↗Kurz gefasst
Fachartikel in der Zeitschrift Chaos: An Interdisciplinary Journal of Nonlinear Science, online erschienen am 13.04.2023. Verfasst von Gianluca Fabiani und 3 weiteren Autor:innen. Beteiligte Einrichtung: Scuola Superiore Meridionale, Largo San Marcellino 10, 80138 Napoli (NA), Italy. Die Arbeit wurde bisher 40-mal zitiert (Crossref) und nennt 95 Literaturangaben. Gefördert von: Ministero dell'Istruzione, dell'Università e della Ricerca.
Abstract (Originalsprache)
We present a numerical method based on random projections with Gaussian kernels and physics-informed neural networks for the numerical solution of initial value problems (IVPs) of nonlinear stiff ordinary differential equations (ODEs) and index-1 differential algebraic equations (DAEs), which may also arise from spatial discretization of partial differential equations (PDEs). The internal weights are fixed to ones while the unknown weights between the hidden and output layer are computed with Newton’s iterations using the Moore–Penrose pseudo-inverse for low to medium scale and sparse QR decomposition with L 2 regularization for medium- to large-scale systems. Building on previous works on random projections, we also prove its approximation accuracy. To deal with stiffness and sharp gradients, we propose an adaptive step-size scheme and address a continuation method for providing good initial guesses for Newton iterations. The “optimal” bounds of the uniform distribution from which the values of the shape parameters of the Gaussian kernels are sampled and the number of basis functions are “parsimoniously” chosen based on bias-variance trade-off decomposition. To assess the performance of the scheme in terms of both numerical approximation accuracy and computational cost, we used eight benchmark problems (three index-1 DAEs problems, and five stiff ODEs problems including the Hindmarsh–Rose neuronal model of chaotic dynamics and the Allen–Cahn phase-field PDE). The efficiency of the scheme was compared against two stiff ODEs/DAEs solvers, namely, ode15s and ode23t solvers of the MATLAB ODE suite as well as against deep learning as implemented in the DeepXDE library for scientific machine learning and physics-informed learning for the solution of the Lotka–Volterra ODEs included in the demos of the library. A software/toolbox in Matlab (that we call RanDiffNet) with demos is also provided.
Autor:innen und Institutionen
- Scuola Superiore Meridionale, Largo San Marcellino 10, 80138 Napoli (NA), Italy.
- Dipartimento di Matematica e Applicazioni "Renato Caccioppoli," Università degli Studi di Napoli Federico II, Corso Umberto I 40, 80138 Napoli (NA), Italy.
- Istituto di Scienze e Tecnologie per l'Energia e la Mobilità Sostenibili, Consiglio Nazionale delle Ricerche, Via Guglielmo Marconi 4, 80125 Napoli (NA), Italy.
ORCID-Profile: Gianluca Fabiani, Evangelos Galaris, Lucia Russo, Constantinos Siettos
Förderung
- Ministero dell'Istruzione, dell'Università e della Ricerca
Zitieren
APA
Fabiani, G., Galaris, E., Russo, L., & Siettos, C. (2023). Parsimonious physics-informed random projection neural networks for initial value problems of ODEs and index-1 DAEs. Chaos: An Interdisciplinary Journal of Nonlinear Science, 33(4). https://doi.org/10.1063/5.0135903
Vancouver
Fabiani G, Galaris E, Russo L, Siettos C. Parsimonious physics-informed random projection neural networks for initial value problems of ODEs and index-1 DAEs. Chaos: An Interdisciplinary Journal of Nonlinear Science. 2023;33(4). doi:10.1063/5.0135903
BibTeX
@article{Fabiani2023,
author = {Fabiani, Gianluca and Galaris, Evangelos and Russo, Lucia and Siettos, Constantinos},
title = {Parsimonious physics-informed random projection neural networks for initial value problems of ODEs and index-1 DAEs},
journal = {Chaos: An Interdisciplinary Journal of Nonlinear Science},
year = {2023},
volume = {33},
number = {4},
doi = {10.1063/5.0135903}
}
EUVIMED