EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Calibrating Bayesian inference

Yang Liu iD, Jonathan P Williams iD, Jan Hannig iD

British Journal of Mathematical and Statistical Psychology · 30.07.2026

DOI: 10.1111/bmsp.70065 ↗

Kurz gefasst

Fachartikel in der Zeitschrift British Journal of Mathematical and Statistical Psychology, online erschienen am 30.07.2026. Verfasst von Yang Liu und 2 weiteren Autor:innen. Beteiligte Einrichtung: University of Maryland, College Park, Maryland, USA. Die Arbeit nennt 86 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Science Foundation, United States-Israel Binational Science Foundation.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Bayesian statistics has gained popularity in psychological research due to its intuitive uncertainty quantification and convenient information‐updating rules. In many applications, however, prior distributions are introduced merely as instruments to facilitate computation, rather than as representations of genuine subjective belief. Consequently, relying on standard Bayesian justifications for inferential procedures becomes conceptually ungrounded. In this paper, we recommend evaluating finite‐sample performance over repeated sampling of data and parameters as an alternative justification for “pragmatic Bayes.” We demonstrate a key vulnerability in the usual posterior‐based inference: when analysts' chosen prior distribution mismatches the true parameter‐generating process, Bayesian inference can be misleading in the long run. Given that this true process is rarely known in practice, we propose a safer alternative: calibrating Bayesian credible regions to achieve frequentist validity. This latter criterion is stronger and guarantees validity of Bayesian inference regardless of the underlying parameter‐generating mechanism. To solve the calibration problem in practice, we propose a novel stochastic approximation algorithm. Monte Carlo experiments are conducted and reported, in which we observe that uncalibrated Bayesian inference can be liberal under certain parameter‐generating scenarios, whereas our calibrated solution consistently maintain validity. We also illustrate the proposed calibration procedure using a real‐data example involving location‐scale regression.

Schlagwörter

Stichwörter der Autor:innen

Bayesian inferenceRiemannian optimizationcredible regionfrequentist inferencestatistical validitystochastic approximation

Autor:innen und Institutionen

  • University of Maryland, College Park, Maryland, USA.
  • North Carolina State University, Raleigh, North Carolina, USA.
  • The University of North Carolina at Chapel Hill, Chapel Hill, North Carolina, USA.

ORCID-Profile: Yang Liu, Jonathan P Williams, Jan Hannig

Förderung

  • National Science Foundation
  • United States-Israel Binational Science Foundation

Zitieren

APA

Liu, Y., Williams, J. P., & Hannig, J. (2026). Calibrating Bayesian inference. British Journal of Mathematical and Statistical Psychology. https://doi.org/10.1111/bmsp.70065

Vancouver

Liu Y, Williams JP, Hannig J. Calibrating Bayesian inference. British Journal of Mathematical and Statistical Psychology. 2026. doi:10.1111/bmsp.70065

BibTeX
@article{Liu2026,
  author = {Liu, Yang and Williams, Jonathan P and Hannig, Jan},
  title = {Calibrating Bayesian inference},
  journal = {British Journal of Mathematical and Statistical Psychology},
  year = {2026},
  doi = {10.1111/bmsp.70065}
}
Kostenlos starten →