EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Multiplicative Gradient Decomposition: A Hybrid Additive–Multiplicative Optimization Framework

Sajedeh Norozpour

Mathematics · 06.05.2026 · 14 (9) · 1572

DOI: 10.3390/math14091572 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Mathematics, online erschienen am 06.05.2026. Verfasst von Sajedeh Norozpour. Die Arbeit nennt 35 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

We propose a unified additive–multiplicative optimization framework, termed hybrid multiplicative gradient decomposition (HMGD), for training machine learning models. Unlike conventional gradient-based methods that rely solely on additive parameter updates, the proposed approach decomposes the gradient into complementary additive and multiplicative components, where the multiplicative term is defined through logarithmic derivative transformations to capture geometric scaling effects. This formulation enables the simultaneous modeling of linear and exponential parameter dynamics, which is particularly relevant in non-convex optimization settings and in models involving multiplicative interactions. The HMGD framework introduces separate momentum mechanisms for additive and multiplicative components, along with norm-based regularization to improve stability and promote structured sparsity in gradient updates. The method can be integrated into standard backpropagation by extending the chain rule to incorporate geometric derivatives. Empirical evaluations on multiple benchmark datasets demonstrate that HMGD achieves consistently faster convergence, improved robustness under multiplicative noise, and competitive or slightly improved performance compared to widely used optimizers such as Adam and RMSProp. Additional analysis shows that the proposed framework induces higher gradient sparsity and maintains stable optimization behavior across training. These results suggest that HMGD provides a flexible and theoretically grounded alternative for optimization in complex learning systems, particularly in scenarios involving nonlinear and multiplicative dynamics.

Zitieren

APA

Norozpour, S. (2026). Multiplicative Gradient Decomposition: A Hybrid Additive–Multiplicative Optimization Framework. Mathematics, 14(9), 1572. https://doi.org/10.3390/math14091572

Vancouver

Norozpour S. Multiplicative Gradient Decomposition: A Hybrid Additive–Multiplicative Optimization Framework. Mathematics. 2026;14(9):1572. doi:10.3390/math14091572

BibTeX
@article{Norozpour2026,
  author = {Norozpour, Sajedeh},
  title = {Multiplicative Gradient Decomposition: A Hybrid Additive–Multiplicative Optimization Framework},
  journal = {Mathematics},
  year = {2026},
  volume = {14},
  number = {9},
  pages = {1572},
  doi = {10.3390/math14091572}
}
Kostenlos starten →