EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Inductive bias and out-of-distribution generalization in deep learning surrogates for 2D PDE dynamics

Binh Duong Nguyen, Stefan Sandfeld

Machine Learning: Science and Technology · 01.10.2026 · 7 (5) · 055055

DOI: 10.1088/2632-2153/aeb34b ↗

Kurz gefasst

Fachartikel in der Zeitschrift Machine Learning: Science and Technology, online erschienen am 30.10.2026. Verfasst von Binh Duong Nguyen und 1 weiteren Autor:innen. Die Arbeit nennt 52 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Helmholtz-Gemeinschaft.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Partial differential equations (PDEs) are a foundational tool for modeling physical systems. However, high-fidelity numerical simulations are often computationally intensive, which has prompted the development of surrogate models in the field of scientific machine learning. While recent approaches have achieved high predictive accuracy by employing complex architectures and extensive datasets, many scientific applications offer only a limited number of simulation trajectories. In this study, we examine the impact of architectural inductive biases on the learning of two-dimensional PDE in data-limited settings. Instead of proposing a highly expressive model, we deliberately adopt a simple multi-channel U-Net modified to enforce periodic boundary conditions. In this study, we compare this architecture with transformer-based and UNet variants such as vision transformer, adaptive Fourier neural operator, PDE-Transformer (PDE-T), and UNet with Kolmogorov–Arnold Layers under a common training setup across five PDE families. To keep comparisons uniform and to mimic partial observability in real measurements, we train all models on rollouts of a single representative scalar field per system. Despite its simplicity, the adapted U-Net consistently matches or outperforms these more complex models in forecasting accuracy, spectral similarity, and physics-based metrics while requiring substantially less training time. The findings of this study demonstrate that, in scenarios where data is limited, the judicious selection of inductive biases can often prove to be more advantageous than increasing the model complexity for the purpose of learning the dynamics of PDEs.

Förderung

  • Helmholtz-Gemeinschaft

Zitieren

APA

Nguyen, B. D., & Sandfeld, S. (2026). Inductive bias and out-of-distribution generalization in deep learning surrogates for 2D PDE dynamics. Machine Learning: Science and Technology, 7(5), 055055. https://doi.org/10.1088/2632-2153/aeb34b

Vancouver

Nguyen BD, Sandfeld S. Inductive bias and out-of-distribution generalization in deep learning surrogates for 2D PDE dynamics. Machine Learning: Science and Technology. 2026;7(5):055055. doi:10.1088/2632-2153/aeb34b

BibTeX
@article{Nguyen2026,
  author = {Nguyen, Binh Duong and Sandfeld, Stefan},
  title = {Inductive bias and out-of-distribution generalization in deep learning surrogates for 2D PDE dynamics},
  journal = {Machine Learning: Science and Technology},
  year = {2026},
  volume = {7},
  number = {5},
  pages = {055055},
  doi = {10.1088/2632-2153/aeb34b}
}
Kostenlos starten →