Inductive bias and out-of-distribution generalization in deep learning surrogates for 2D PDE dynamics
Machine Learning: Science and Technology · 01.10.2026 · 7 (5) · 055055
DOI: 10.1088/2632-2153/aeb34b ↗Kurz gefasst
Fachartikel in der Zeitschrift Machine Learning: Science and Technology, online erschienen am 30.10.2026. Verfasst von Binh Duong Nguyen und 1 weiteren Autor:innen. Die Arbeit nennt 52 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Helmholtz-Gemeinschaft.
Abstract (Originalsprache)
Partial differential equations (PDEs) are a foundational tool for modeling physical systems. However, high-fidelity numerical simulations are often computationally intensive, which has prompted the development of surrogate models in the field of scientific machine learning. While recent approaches have achieved high predictive accuracy by employing complex architectures and extensive datasets, many scientific applications offer only a limited number of simulation trajectories. In this study, we examine the impact of architectural inductive biases on the learning of two-dimensional PDE in data-limited settings. Instead of proposing a highly expressive model, we deliberately adopt a simple multi-channel U-Net modified to enforce periodic boundary conditions. In this study, we compare this architecture with transformer-based and UNet variants such as vision transformer, adaptive Fourier neural operator, PDE-Transformer (PDE-T), and UNet with Kolmogorov–Arnold Layers under a common training setup across five PDE families. To keep comparisons uniform and to mimic partial observability in real measurements, we train all models on rollouts of a single representative scalar field per system. Despite its simplicity, the adapted U-Net consistently matches or outperforms these more complex models in forecasting accuracy, spectral similarity, and physics-based metrics while requiring substantially less training time. The findings of this study demonstrate that, in scenarios where data is limited, the judicious selection of inductive biases can often prove to be more advantageous than increasing the model complexity for the purpose of learning the dynamics of PDEs.
Förderung
- Helmholtz-Gemeinschaft
Zitieren
APA
Nguyen, B. D., & Sandfeld, S. (2026). Inductive bias and out-of-distribution generalization in deep learning surrogates for 2D PDE dynamics. Machine Learning: Science and Technology, 7(5), 055055. https://doi.org/10.1088/2632-2153/aeb34b
Vancouver
Nguyen BD, Sandfeld S. Inductive bias and out-of-distribution generalization in deep learning surrogates for 2D PDE dynamics. Machine Learning: Science and Technology. 2026;7(5):055055. doi:10.1088/2632-2153/aeb34b
BibTeX
@article{Nguyen2026,
author = {Nguyen, Binh Duong and Sandfeld, Stefan},
title = {Inductive bias and out-of-distribution generalization in deep learning surrogates for 2D PDE dynamics},
journal = {Machine Learning: Science and Technology},
year = {2026},
volume = {7},
number = {5},
pages = {055055},
doi = {10.1088/2632-2153/aeb34b}
}
EUVIMED