EUVIMEDEUVIMED entdecken
Crossref

Malliavin Calculus as Stochastic Backpropagation for Gaussian Latent Models: A Variance-Optimal Hybrid Framework

Oden Kevin D

IgMin Research · 20.04.2026 · 4 (4) · 116-140

DOI: 10.61927/igmin339 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IgMin Research, online erschienen am 20.04.2026. Verfasst von Oden Kevin D. Die Arbeit nennt 21 Literaturangaben.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

We establish a rigorous connection between pathwise (reparameterization) and score-function (Malliavin) gradient estimators by showing that both arise from the Malliavin integration-by-parts identity. Building on this equivalence, we introduce a unified and variance-aware hybrid estimator that adaptively combines pathwise and Malliavin gradients using their empirical covariance structure. The connection is established explicitly for Gaussian (and more generally exponential family) latent variable models, where integration-by-parts identities admit closed-form representations. The resulting formulation provides a principled understanding of stochastic backpropagation and achieves minimum variance in theory among all unbiased linear combinations, with closed-form finite-sample convergence bounds. We demonstrate 9% variance reduction on VAEs (CIFAR-10) and up to 35% on strongly-coupled synthetic problems. Exploratory policy gradient experiments reveal that non-stationary optimization landscapes present challenges for the hybrid approach, highlighting important directions for future work. Overall, this work positions Malliavin calculus as a conceptually unifying and practically interpretable framework for stochastic gradient estimation, clarifying when hybrid approaches provide tangible benefits and when they face inherent limitations.

Zitieren

APA

D, O. K. (2026). Malliavin Calculus as Stochastic Backpropagation for Gaussian Latent Models: A Variance-Optimal Hybrid Framework. IgMin Research, 4(4), 116-140. https://doi.org/10.61927/igmin339

Vancouver

D OK. Malliavin Calculus as Stochastic Backpropagation for Gaussian Latent Models: A Variance-Optimal Hybrid Framework. IgMin Research. 2026;4(4):116-140. doi:10.61927/igmin339

BibTeX
@article{D2026,
  author = {D, Oden Kevin},
  title = {Malliavin Calculus as Stochastic Backpropagation for Gaussian Latent Models: A Variance-Optimal Hybrid Framework},
  journal = {IgMin Research},
  year = {2026},
  volume = {4},
  number = {4},
  pages = {116--140},
  doi = {10.61927/igmin339}
}
Kostenlos starten →