Physics-Constrained Bayesian Neural Network for Bias and Variance Reduction
Journal of Computing and Information Science in Engineering · 01.02.2023 · 23 (1)
DOI: 10.1115/1.4055924 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Computing and Information Science in Engineering, online erschienen am 08.11.2022. Verfasst von Luka Malashkhia und 3 weiteren Autor:innen. Die Arbeit wurde bisher 14-mal zitiert (Crossref) und nennt 30 Literaturangaben.
Abstract (Originalsprache)
When neural networks are applied to solve complex engineering problems, the lack of training data can make the predictions of the surrogate inaccurate. Recently, physics-constrained neural networks were introduced to integrate physical models in the data-driven surrogate to improve the training efficiency with limited data. Nevertheless, the model-form and parameter uncertainty associated with the neural networks can still lead to unreliable predictions. In this article, a new physics-constrained Bayesian neural network (PCBNN) framework is proposed to quantify the uncertainty in physics-constrained neural networks. The bias and variance of predictions are considered simultaneously during the PCBNN training process. The variance and Kullback–Leibler divergence of neural network parameters are incorporated in the total loss function. The weights associated with the different losses are adjusted adaptively. The training of PCBNNs is also formulated as solving a minimax problem where the loss function for the worst-case scenario is minimized. The new PCBNN framework is demonstrated with engineering examples of heat transfer and phase transition based on both simulation data and experimental measurements. The results show that the accuracy and precision of predictions can be improved with the variance consideration in the PCBNN.
Zitieren
APA
Malashkhia, L., Liu, D., Lu, Y., & Wang, Y. (2023). Physics-Constrained Bayesian Neural Network for Bias and Variance Reduction. Journal of Computing and Information Science in Engineering, 23(1). https://doi.org/10.1115/1.4055924
Vancouver
Malashkhia L, Liu D, Lu Y, Wang Y. Physics-Constrained Bayesian Neural Network for Bias and Variance Reduction. Journal of Computing and Information Science in Engineering. 2023;23(1). doi:10.1115/1.4055924
BibTeX
@article{Malashkhia2023,
author = {Malashkhia, Luka and Liu, Dehao and Lu, Yanglong and Wang, Yan},
title = {Physics-Constrained Bayesian Neural Network for Bias and Variance Reduction},
journal = {Journal of Computing and Information Science in Engineering},
year = {2023},
volume = {23},
number = {1},
doi = {10.1115/1.4055924}
}
EUVIMED