Pareto-optimal trees and Pareto forest: a bi-objective optimization model for binary classification
Computational Optimization and Applications · 09.06.2026
DOI: 10.1007/s10589-026-00799-9 ↗Kurz gefasst
Fachartikel in der Zeitschrift Computational Optimization and Applications, online erschienen am 09.06.2026. Verfasst von Marianna De Santis und 2 weiteren Autor:innen. Die Arbeit nennt 38 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: MICIU/AEI, IMUS-Maria de Maeztu grant.
Abstract (Originalsprache)
As inherently transparent models, classification trees play a central role in interpretable machine learning by providing easily traceable decision paths that allow users to understand how input features contribute to specific predictions. In this work, we introduce a new class of interpretable binary classification models, named Pareto-optimal trees, which aim at combining the complementary strengths of Optimal Classification Trees with Hyperplane-based splits (OCT-H) and Support Vector Machines (SVM). We formulate a bi-objective mixed-integer quadratic optimization problem, whose nondominated solutions represent trade-offs between these two different classification techniques. To further enhance robustness and performance, we propose the Pareto forest, an ensemble method based on the Pareto-optimal trees, aggregated through majority voting. Extensive experiments on benchmark datasets demonstrate that our models can outperform standard methods such as CART and OCT, underscoring the improvements gained through the bi-objective perspective. In particular, Pareto-optimal trees unify the ability of OCT-H and SVM within a single framework, resulting in enhanced classification performance relative to either method alone. Embracing a multiobjective perspective allows the construction of multiple “high quality" trees. Our comparison between Pareto forests and random forests shows that building shallow ensembles from a small number of such optimized trees outperforms relying on a large set of random trees with variable depth.
Förderung
- MICIU/AEI
- IMUS-Maria de Maeztu grant
Zitieren
APA
Santis, M. D., Patria, D., & Puerto, J. (2026). Pareto-optimal trees and Pareto forest: a bi-objective optimization model for binary classification. Computational Optimization and Applications. https://doi.org/10.1007/s10589-026-00799-9
Vancouver
Santis MD, Patria D, Puerto J. Pareto-optimal trees and Pareto forest: a bi-objective optimization model for binary classification. Computational Optimization and Applications. 2026. doi:10.1007/s10589-026-00799-9
BibTeX
@article{Santis2026,
author = {Santis, Marianna De and Patria, Daniele and Puerto, Justo},
title = {Pareto-optimal trees and Pareto forest: a bi-objective optimization model for binary classification},
journal = {Computational Optimization and Applications},
year = {2026},
doi = {10.1007/s10589-026-00799-9}
}
EUVIMED