EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Gradient-based smoothing parameter estimation for neural P-splines

Lea M. Dammann, Marei Freitag, Anton Thielmann, Benjamin Säfken

Computational Statistics · 2025-09 · 40 (7) · 3645-3663

DOI: 10.1007/s00180-024-01593-z ↗

Kurz gefasst

Fachartikel in der Zeitschrift Computational Statistics, online erschienen am 09.01.2025. Verfasst von Lea M. Dammann und 3 weiteren Autor:innen. Die Arbeit wurde bisher 3-mal zitiert (Crossref) und nennt 43 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Deutsche Forschungsgemeinschaft.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Due to the popularity of deep learning models there have recently been many attempts to translate generalized additive models to neural nets. Generalized additive models are usually regularized by a penalty in the loss function and the magnitude of penalization is controlled by one or more smoothing parameters. In the statistical literature these smoothing parameters are estimated by criteria such as generalized cross-validation or restricted maximum likelihood. While the estimation of the primary regression coefficients is well calibrated and investigated for neural net based additive models, the estimation of smoothing parameters is often either based on testing data (and grid search), implicitly estimated or completely neglected. In this paper, we address the issue of explicit smoothing parameter estimation in neural net-based additive models fitted via gradient-based methods, such as the well-known Adam algorithm. We therefore investigate the data-driven smoothing parameter selection via gradient-based optimization of generalized cross-validation and restricted maximum likelihood. Thus we do not need to calculate Hessian information of the smoothing parameters. As an additive model structure, we use a translation of P-splines to neural nets, so-called neural P-splines. The fitting process of neural P-splines as well as the gradient-based smoothing parameter selection are investigated in a simulation study and an application.

Förderung

  • Deutsche Forschungsgemeinschaft

Zitieren

APA

Dammann, L. M., Freitag, M., Thielmann, A., & Säfken, B. (2025). Gradient-based smoothing parameter estimation for neural P-splines. Computational Statistics, 40(7), 3645-3663. https://doi.org/10.1007/s00180-024-01593-z

Vancouver

Dammann LM, Freitag M, Thielmann A, Säfken B. Gradient-based smoothing parameter estimation for neural P-splines. Computational Statistics. 2025;40(7):3645-3663. doi:10.1007/s00180-024-01593-z

BibTeX
@article{Dammann2025,
  author = {Dammann, Lea M. and Freitag, Marei and Thielmann, Anton and Säfken, Benjamin},
  title = {Gradient-based smoothing parameter estimation for neural P-splines},
  journal = {Computational Statistics},
  year = {2025},
  volume = {40},
  number = {7},
  pages = {3645--3663},
  doi = {10.1007/s00180-024-01593-z}
}
Kostenlos starten →