On Simple EM Acceleration Schemes Suitable for Mixture Modelling with High Overlap Between Components
Mathematics · 01.05.2026 · 14 (9) · 1543
DOI: 10.3390/math14091543 ↗Kurz gefasst
Fachartikel in der Zeitschrift Mathematics, online erschienen am 01.05.2026. Verfasst von Branislav Panić und 3 weiteren Autor:innen. Die Arbeit nennt 30 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: The Slovenian Research and Innovation Agency.
Abstract (Originalsprache)
The Expectation-Maximisation (EM) algorithm is widely used for maximum likelihood estimation in incomplete data problems such as mixture modelling, but it often converges slowly, particularly when mixture components overlap substantially. This study presents a comprehensive empirical evaluation of simple EM acceleration schemes for Gaussian mixture models, comparing linear (STEM), quadratic (SQUAREM), and greedy (line search, golden section) methods across 240 simulated mixture configurations spanning three dimensionalities, four component counts, five overlap levels, and four sample sizes. A key contribution is the first systematic comparison of the three acceleration parameter estimates (α1, α2, α3) in the mixture modelling context: we show that only α3, which is derived as the geometric mean estimate of α1 and α2, provides genuine acceleration, while α1 and α2 consistently increase iteration counts by 50–110% relative to α3, effectively acting as deceleration. With α3, SQUAREM reduces iterations by up to 48% with negligible computational overhead, while greedy methods achieve similar iteration reductions but at 50–110% greater wall-clock time due to repeated log-likelihood evaluations. Crucially, acceleration does not degrade parameter estimation quality under any tested combination of initialisation, overlap, dimensionality, or number of components. We further examine the interaction between acceleration and initialisation, finding that k-means benefits most from acceleration (up to 50% time savings), while the REBMIX (Rough-Enhanced-Bayes MIXture estimation) algorithm benefits least as it already starts near the optimum. Among REBMIX configurations, histogram preprocessing with the outliers mode traversing strategy offers the best trade-off between quality and computational cost. The findings are validated on a real-world Backblaze hard drive failure dataset, confirming the practical utility of EM acceleration. All methods are implemented in the free and open-source R package rebmix, accompanied by full source code.
Förderung
- The Slovenian Research and Innovation Agency
Zitieren
APA
Panić, B., Klemenc, J., Nagode, M., & Oman, S. (2026). On Simple EM Acceleration Schemes Suitable for Mixture Modelling with High Overlap Between Components. Mathematics, 14(9), 1543. https://doi.org/10.3390/math14091543
Vancouver
Panić B, Klemenc J, Nagode M, Oman S. On Simple EM Acceleration Schemes Suitable for Mixture Modelling with High Overlap Between Components. Mathematics. 2026;14(9):1543. doi:10.3390/math14091543
BibTeX
@article{Pani2026,
author = {Panić, Branislav and Klemenc, Jernej and Nagode, Marko and Oman, Simon},
title = {On Simple EM Acceleration Schemes Suitable for Mixture Modelling with High Overlap Between Components},
journal = {Mathematics},
year = {2026},
volume = {14},
number = {9},
pages = {1543},
doi = {10.3390/math14091543}
}
EUVIMED