Factorization Machine from a Random Matrix Theory Perspective
Journal of the Physical Society of Japan · 15.06.2026 · 95 (6)
DOI: 10.7566/jpsj.95.064003 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of the Physical Society of Japan, erschienen am 15.06.2026. Verfasst von Hyakka Nakada und 1 weiteren Autor:innen. Die Arbeit nennt 45 Literaturangaben. Gefördert von: Japan Science and Technology Agency.
Abstract (Originalsprache)
Factorization Machine with Quadratic-optimization Annealing (FMQA) is a promising technique for solving black-box optimization problems efficiently. Recently, warm-starting FMQA has been proposed to accelerate an FMQA process by initializing the Factorization Machine (FM) with a pre-computed interaction matrix. However, the mechanism underlying its effectiveness remains unclear. Therefore, in this study, we utilize random matrix theory to investigate the performance of FM initialization. We derive modified results within random matrix theory that describe the statistical properties of min-max normalized eigenvalues in random matrices. Our analysis estimates the residual coupling error that arises during FM initialization via low-rank approximation. Numerical experiments demonstrate that our theoretical predictions for the coupling error exhibit excellent agreement with empirical results. Furthermore, we show that subsequent training effectively reduces the error below the theoretical baseline defined by random matrix theory, confirming that the warm-starting approach provides a robust starting point for optimization. These insights not only reinforce the validity of warm-starting FMQA but also suggest broader applications in efficient model initialization, such as low-rank adaptation for large language models.
Förderung
- Japan Science and Technology Agency
Zitieren
APA
Nakada, H., & Tanaka, S. (2026). Factorization Machine from a Random Matrix Theory Perspective. Journal of the Physical Society of Japan, 95(6). https://doi.org/10.7566/jpsj.95.064003
Vancouver
Nakada H, Tanaka S. Factorization Machine from a Random Matrix Theory Perspective. Journal of the Physical Society of Japan. 2026;95(6). doi:10.7566/jpsj.95.064003
BibTeX
@article{Nakada2026,
author = {Nakada, Hyakka and Tanaka, Shu},
title = {Factorization Machine from a Random Matrix Theory Perspective},
journal = {Journal of the Physical Society of Japan},
year = {2026},
volume = {95},
number = {6},
doi = {10.7566/jpsj.95.064003}
}
EUVIMED