Parallel MCMC via machine learning classification and a Kullback–Leibler divergence criterion
METRON · 2026-08 · 84 (2) · 139-157
DOI: 10.1007/s40300-026-00316-2 ↗Kurz gefasst
Fachartikel in der Zeitschrift METRON, online erschienen am 10.07.2026. Verfasst von Tomoki Matsumoto. Die Arbeit nennt 16 Literaturangaben. Gefördert von: Japan Society for the Promotion of Science.
Abstract (Originalsprache)
In the era of Big Data, Markov chain Monte Carlo (MCMC) methods, which are currently essential for Bayesian estimation, face significant computational challenges owing to their sequential nature. To achieve a faster and more effective parallel computation, we emphasize the critical role of the overlapped area of the posterior distributions based on partitioned data, which we term the reconstructable area. We propose a method that utilizes machine learning classifiers to effectively identify and extract MCMC draws obtained by parallel computations from the area based on posteriors based on partitioned sub-datasets, approximating the target posterior distribution based on the full dataset. This study also develops a Kullback–Leibler (KL) divergence-based criterion. It does not require calculating the full-posterior density and can be calculated using only information from the sub-posterior densities, which are generally obtained after implementing MCMC. This simplifies the hyperparameter tuning in training classifiers. The simulation studies validated the efficacy of the proposed method. This approach contributes to ongoing research on parallelizing MCMC methods and may offer insights for future developments in Bayesian computation for large-scale data analyses.
Förderung
- Japan Society for the Promotion of Science
Zitieren
APA
Matsumoto, T. (2026). Parallel MCMC via machine learning classification and a Kullback–Leibler divergence criterion. METRON, 84(2), 139-157. https://doi.org/10.1007/s40300-026-00316-2
Vancouver
Matsumoto T. Parallel MCMC via machine learning classification and a Kullback–Leibler divergence criterion. METRON. 2026;84(2):139-157. doi:10.1007/s40300-026-00316-2
BibTeX
@article{Matsumoto2026,
author = {Matsumoto, Tomoki},
title = {Parallel MCMC via machine learning classification and a Kullback–Leibler divergence criterion},
journal = {METRON},
year = {2026},
volume = {84},
number = {2},
pages = {139--157},
doi = {10.1007/s40300-026-00316-2}
}
EUVIMED