EUVIMEDEUVIMED entdecken
Crossref

Factorization Machine from a Random Matrix Theory Perspective

Hyakka Nakada, Shu Tanaka

Journal of the Physical Society of Japan · 15.06.2026 · 95 (6)

DOI: 10.7566/jpsj.95.064003 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of the Physical Society of Japan, erschienen am 15.06.2026. Verfasst von Hyakka Nakada und 1 weiteren Autor:innen. Die Arbeit nennt 45 Literaturangaben. Gefördert von: Japan Science and Technology Agency.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Factorization Machine with Quadratic-optimization Annealing (FMQA) is a promising technique for solving black-box optimization problems efficiently. Recently, warm-starting FMQA has been proposed to accelerate an FMQA process by initializing the Factorization Machine (FM) with a pre-computed interaction matrix. However, the mechanism underlying its effectiveness remains unclear. Therefore, in this study, we utilize random matrix theory to investigate the performance of FM initialization. We derive modified results within random matrix theory that describe the statistical properties of min-max normalized eigenvalues in random matrices. Our analysis estimates the residual coupling error that arises during FM initialization via low-rank approximation. Numerical experiments demonstrate that our theoretical predictions for the coupling error exhibit excellent agreement with empirical results. Furthermore, we show that subsequent training effectively reduces the error below the theoretical baseline defined by random matrix theory, confirming that the warm-starting approach provides a robust starting point for optimization. These insights not only reinforce the validity of warm-starting FMQA but also suggest broader applications in efficient model initialization, such as low-rank adaptation for large language models.

Förderung

  • Japan Science and Technology Agency

Zitieren

APA

Nakada, H., & Tanaka, S. (2026). Factorization Machine from a Random Matrix Theory Perspective. Journal of the Physical Society of Japan, 95(6). https://doi.org/10.7566/jpsj.95.064003

Vancouver

Nakada H, Tanaka S. Factorization Machine from a Random Matrix Theory Perspective. Journal of the Physical Society of Japan. 2026;95(6). doi:10.7566/jpsj.95.064003

BibTeX
@article{Nakada2026,
  author = {Nakada, Hyakka and Tanaka, Shu},
  title = {Factorization Machine from a Random Matrix Theory Perspective},
  journal = {Journal of the Physical Society of Japan},
  year = {2026},
  volume = {95},
  number = {6},
  doi = {10.7566/jpsj.95.064003}
}
Kostenlos starten →