EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

An Analysis of Vectorised Automatic Differentiation for Statistical Applications

Chun Fung Kwok, Dan Zhu, Liana Jacobi

Stats · 19.05.2025 · 8 (2) · 40

DOI: 10.3390/stats8020040 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Stats, online erschienen am 19.05.2025. Verfasst von Chun Fung Kwok und 2 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 36 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Australian Research Council.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Automatic differentiation (AD) is a general method for computing exact derivatives in complex sensitivity analyses and optimisation tasks, particularly when closed-form solutions are unavailable and traditional analytical or numerical methods fall short. This paper introduces a vectorised formulation of AD grounded in matrix calculus. It aligns naturally with the matrix-oriented style prevalent in statistics, supports convenient implementations, and takes advantage of sparse matrix representation and other high-level optimisation techniques that are not available in the scalar counterpart. Our formulation is well-suited to high-dimensional statistical applications, where finite differences (FD) scale poorly due to the need to repeat computations for each input dimension, resulting in significant overhead, and is advantageous in simulation-intensive settings—such as Markov Chain Monte Carlo (MCMC)-based inference—where FD requires repeated sampling and multiple function evaluations, while AD can compute exact derivatives in a single pass, substantially reducing computational cost. Numerical studies are presented to demonstrate the efficacy and speed of the proposed AD method compared with FD schemes.

Förderung

  • Australian Research Council

Zitieren

APA

Kwok, C. F., Zhu, D., & Jacobi, L. (2025). An Analysis of Vectorised Automatic Differentiation for Statistical Applications. Stats, 8(2), 40. https://doi.org/10.3390/stats8020040

Vancouver

Kwok CF, Zhu D, Jacobi L. An Analysis of Vectorised Automatic Differentiation for Statistical Applications. Stats. 2025;8(2):40. doi:10.3390/stats8020040

BibTeX
@article{Kwok2025,
  author = {Kwok, Chun Fung and Zhu, Dan and Jacobi, Liana},
  title = {An Analysis of Vectorised Automatic Differentiation for Statistical Applications},
  journal = {Stats},
  year = {2025},
  volume = {8},
  number = {2},
  pages = {40},
  doi = {10.3390/stats8020040}
}
Kostenlos starten →