EUVIMEDEUVIMED entdecken
Crossref

Information-Based Calibration of Uncertainty Quantification in Product-of-Experts Gaussian Process Models

Yean Hoon Ong, Paolo Barucca, Wei Pan, Jun Wang

Journal of Artificial Intelligence Research · 15.08.2026 · 86

DOI: 10.1613/jair.1.20374 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Artificial Intelligence Research, online erschienen am 15.08.2026. Verfasst von Yean Hoon Ong und 3 weiteren Autor:innen.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background

In Gaussian process (GP) regression, the use of a single global GP (GP-glo) incurs cubic computational cost, which limits scalability to large datasets. Product-of-experts GP models (GP-pro), which combine a collection of local GP models that collaboratively capture global correlations, provide a prominent approach to alleviating this computational burden. However, GP-pro models often produce overestimated posterior variances due to training local experts on disjoint subsets of the data.

Objectives

This study aims to analyse the overestimation of posterior variances in GP-pro models and to address this issue using an information-based method.

Methods

We propose GP-pro-c, a product-of-experts Gaussian process model that incorporates an information-based method to calibrate the overestimated posterior variances. The method uses the monotonicity and submodularity properties of information gain in GP to define a calibration ratio that appropriately reduces the posterior variance of individual local GP models.

Results

The performance of GP-pro-c was evaluated using three metrics: negative log-likelihood (NLL), root mean squared error (RMSE), and expected normalised calibration error (ENCE) of the uncertainty estimates. Empirical experiments on four synthetic functions and six regression datasets show that the proposed calibration method enables the GP-pro-c model to achieve average reductions of 2.3% and 12.0% in NLL and ENCE, respectively, compared to the uncalibrated GP-pro model.

Conclusions

The results demonstrate that GP-pro-c effectively mitigates the overestimation of posterior variances in product-of-experts Gaussian process models while maintaining predictive accuracy and reducing computational complexity. These findings suggest that the proposed information-based calibration method is a promising approach for improving uncertainty estimation in scalable GP models. We expect the GP-pro-c to serve as a useful surrogate model in Bayesian optimisation settings involving high-dimensional and large-scale data.

Zitieren

APA

Ong, Y. H., Barucca, P., Pan, W., & Wang, J. (2026). Information-Based Calibration of Uncertainty Quantification in Product-of-Experts Gaussian Process Models. Journal of Artificial Intelligence Research, 86. https://doi.org/10.1613/jair.1.20374

Vancouver

Ong YH, Barucca P, Pan W, Wang J. Information-Based Calibration of Uncertainty Quantification in Product-of-Experts Gaussian Process Models. Journal of Artificial Intelligence Research. 2026;86. doi:10.1613/jair.1.20374

BibTeX
@article{Ong2026,
  author = {Ong, Yean Hoon and Barucca, Paolo and Pan, Wei and Wang, Jun},
  title = {Information-Based Calibration of Uncertainty Quantification in Product-of-Experts Gaussian Process Models},
  journal = {Journal of Artificial Intelligence Research},
  year = {2026},
  volume = {86},
  doi = {10.1613/jair.1.20374}
}
Kostenlos starten →