EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Exploiting residual errors in nonlinear online prediction

Emirhan Ilhan, Ahmet B. Koc, Suleyman S. Kozat

Machine Learning · 2024-09 · 113 (9) · 6065-6091

DOI: 10.1007/s10994-024-06554-7 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Machine Learning, online erschienen am 29.05.2024. Verfasst von Emirhan Ilhan und 2 weiteren Autor:innen. Die Arbeit wurde bisher 12-mal zitiert (Crossref) und nennt 36 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Türkiye Bilimler Akademisi, Turk Telekom, Bilkent University.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

We introduce a novel online (or sequential) nonlinear prediction approach that incorporates the residuals, i.e., prediction errors in the past observations, as additional features for the current data. Including the past error terms in an online prediction algorithm naturally improves prediction performance significantly since this information is essential for an algorithm to adjust itself based on its past errors. These terms are well exploited in many linear statistical models such as ARMA, SES, and Holts-Winters models. However, the past error terms are rarely or in a certain sense not optimally exploited in nonlinear prediction models since training them requires complex nonlinear state-space modeling. To this end, for the first time in the literature, we introduce a nonlinear prediction framework that utilizes not only the current features but also the past error terms as additional features, thereby exploiting the residual state information in the error terms, i.e., the model’s performance on the past samples. Since the new feature vectors contain error terms that change with every update, our algorithm jointly optimizes the model parameters and the feature vectors simultaneously. We achieve this by introducing new update equations that handle the effects resulting from the changes in the feature vectors in an online manner. We use soft decision trees and neural networks as the nonlinear prediction algorithms since these are the most widely used methods in highly publicized competitions. However, as we show, our methods are generic and any algorithm supporting gradient calculations can be straightforwardly used. We show through our experiments on the well-known real-life competition datasets that our method significantly outperforms the state-of-the-art. We also provide the implementation of our approach including the source code to facilitate reproducibility ( https://github.com/ahmetberkerkoc/SDT-ARMA ).

Förderung

  • Türkiye Bilimler Akademisi
  • Turk Telekom
  • Bilkent University

Zitieren

APA

Ilhan, E., Koc, A. B., & Kozat, S. S. (2024). Exploiting residual errors in nonlinear online prediction. Machine Learning, 113(9), 6065-6091. https://doi.org/10.1007/s10994-024-06554-7

Vancouver

Ilhan E, Koc AB, Kozat SS. Exploiting residual errors in nonlinear online prediction. Machine Learning. 2024;113(9):6065-6091. doi:10.1007/s10994-024-06554-7

BibTeX
@article{Ilhan2024,
  author = {Ilhan, Emirhan and Koc, Ahmet B. and Kozat, Suleyman S.},
  title = {Exploiting residual errors in nonlinear online prediction},
  journal = {Machine Learning},
  year = {2024},
  volume = {113},
  number = {9},
  pages = {6065--6091},
  doi = {10.1007/s10994-024-06554-7}
}
Kostenlos starten →