Speeding up Collocation-based Robust Variational Physics Informed Neural Networks with Singular Value Decompositions
Bulletin of the Polish Academy of Sciences Technical Sciences · 22.10.2026 · 7073
DOI: 10.24425/bpasts.2027.7073 ↗Kurz gefasst
Fachartikel in der Zeitschrift Bulletin of the Polish Academy of Sciences Technical Sciences, online erschienen am 22.10.2026. Verfasst von Tomasz Słu˙zalec und 3 weiteren Autor:innen. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Physics Informed Neural Networks (PINNs) solve time-dependent Partial Differential Equations (PDEs) by minimizing the residual, initial, and boundary conditions loss functions. The loss functions in PINN are generally not robust. The decrease in the loss function may not correspond to the decrease by the true error (the norm difference between the numerical and exact solution). Following the idea of Robust Variational PINN (RVPINN), we define the robust loss function by employing the weak residuals and the inverse of the Gram matrix as the discrete representative of the Riesz residual. To avoid the expensive integration of the weak residuals, we introduce the collocation method, where we use discrete weak formulations with integration replaced by summations at the collocation points and test functions replaced by Kronecker deltas. With this setup, we derive a sparse Gram matrix as the H10 discrete inner product of the Kronecker delta test functions. The inverse of this Gram matrix can make the loss function robust. Furthermore, to accelerate the training process, we perform a truncated Singular Value Decomposition (SVD) of the inverse of the Gram matrix and use fast matrix-vector multiplication for the reduced rank matrix. The presented strategy reduces the cost of precomputing (before training) from 𝒪(N3) (inversion of the Gram matrix) to 𝒪(N2k) (truncated SVD decomposition for k
Zitieren
APA
Słu˙zalec, T., Dobija, M., Sikora, M., & Paszyński, M. (2026). Speeding up Collocation-based Robust Variational Physics Informed Neural Networks with Singular Value Decompositions. Bulletin of the Polish Academy of Sciences Technical Sciences, 7073. https://doi.org/10.24425/bpasts.2027.7073
Vancouver
Słu˙zalec T, Dobija M, Sikora M, Paszyński M. Speeding up Collocation-based Robust Variational Physics Informed Neural Networks with Singular Value Decompositions. Bulletin of the Polish Academy of Sciences Technical Sciences. 2026:7073. doi:10.24425/bpasts.2027.7073
BibTeX
@article{Suzalec2026,
author = {Słu˙zalec, Tomasz and Dobija, Mateusz and Sikora, Maciej and Paszyński, Maciej},
title = {Speeding up Collocation-based Robust Variational Physics Informed Neural Networks with Singular Value Decompositions},
journal = {Bulletin of the Polish Academy of Sciences Technical Sciences},
year = {2026},
pages = {7073},
doi = {10.24425/bpasts.2027.7073}
}
EUVIMED