EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

A Novel Gradient-Based Method for Decision Trees Optimizing Arbitrary Differential Loss Functions

Andrei Konstantinov, Lev Utkin, Vladimir Muliukha

Mathematics · 20.04.2026 · 14 (8) · 1379

DOI: 10.3390/math14081379 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Mathematics, online erschienen am 20.04.2026. Verfasst von Andrei Konstantinov und 2 weiteren Autor:innen. Die Arbeit nennt 36 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Ministry of Science and Higher Education of the Russian Federation.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

There are many approaches for training decision trees. This work introduces a novel gradient-based method for constructing decision trees that optimize arbitrary differentiable loss functions, overcoming the limitations of heuristic splitting rules. Unlike traditional approaches that rely on heuristic splitting rules, the proposed method refines predictions using the first and second derivatives of the loss function, enabling the optimization of complex tasks such as classification, regression, and survival analysis. We demonstrate the method’s applicability to classification, regression, and survival analysis tasks, including those with censored data. Numerical experiments on both real and synthetic datasets compare the proposed method with traditional decision tree algorithms such as CART, Extremely Randomized Trees, and SurvTree. The implementation of the method is publicly available, providing a practical tool for researchers and practitioners. This work advances the field of decision tree-based modeling, offering a more flexible and accurate approach for handling structured data and complex tasks. By leveraging gradient-based optimization, the proposed method bridges the gap between traditional decision trees and modern machine learning techniques, paving the way for further innovations in interpretable and high-performing models.

Förderung

  • Ministry of Science and Higher Education of the Russian Federation

Zitieren

APA

Konstantinov, A., Utkin, L., & Muliukha, V. (2026). A Novel Gradient-Based Method for Decision Trees Optimizing Arbitrary Differential Loss Functions. Mathematics, 14(8), 1379. https://doi.org/10.3390/math14081379

Vancouver

Konstantinov A, Utkin L, Muliukha V. A Novel Gradient-Based Method for Decision Trees Optimizing Arbitrary Differential Loss Functions. Mathematics. 2026;14(8):1379. doi:10.3390/math14081379

BibTeX
@article{Konstantinov2026,
  author = {Konstantinov, Andrei and Utkin, Lev and Muliukha, Vladimir},
  title = {A Novel Gradient-Based Method for Decision Trees Optimizing Arbitrary Differential Loss Functions},
  journal = {Mathematics},
  year = {2026},
  volume = {14},
  number = {8},
  pages = {1379},
  doi = {10.3390/math14081379}
}
Kostenlos starten →