EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

On the effect of noise on fitting linear regression models

Insha Ullah, A.H. Welsh

Computational Statistics & Data Analysis · 2026-12 · 224 · 108421

DOI: 10.1016/j.csda.2026.108421 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Computational Statistics & Data Analysis, 2026-12. Verfasst von Insha Ullah und 1 weiteren Autor:innen. Die Arbeit nennt 31 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: CSIRO Data61 Business Unit, Commonwealth Scientific and Industrial Research Organisation.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

In this study, we explore the effects of including noise predictors and noise observations when fitting linear regression models. We present empirical and theoretical results that show that double descent occurs in both cases, albeit with contradictory implications: the implication for noise predictors is that complex models are often better than simple ones, while the implication for noise observations is that simple models are often better than complex ones. We resolve this contradiction by showing that it is not the model complexity but rather the implicit shrinkage by the inclusion of noise in the model that drives the double descent. Specifically, we show how noise predictors or observations shrink the estimators of the regression coefficients and make the test error asymptote, and then how the asymptotes of the test error and the ``condition number anomaly'' ensure that double descent occurs. We also show that including noise observations in the model makes the (usually unbiased) ordinary least squares estimator biased and indicates that the ridge regression estimator may need a negative ridge parameter to avoid over-shrinkage.

Förderung

  • CSIRO Data61 Business Unit
  • Commonwealth Scientific and Industrial Research Organisation

Zitieren

APA

Ullah, I., & Welsh, A. (2026). On the effect of noise on fitting linear regression models. Computational Statistics & Data Analysis, 224, 108421. https://doi.org/10.1016/j.csda.2026.108421

Vancouver

Ullah I, Welsh A. On the effect of noise on fitting linear regression models. Computational Statistics & Data Analysis. 2026;224:108421. doi:10.1016/j.csda.2026.108421

BibTeX
@article{Ullah2026,
  author = {Ullah, Insha and Welsh, A.H.},
  title = {On the effect of noise on fitting linear regression models},
  journal = {Computational Statistics & Data Analysis},
  year = {2026},
  volume = {224},
  pages = {108421},
  doi = {10.1016/j.csda.2026.108421}
}
Kostenlos starten →