MAPTree: Beating “Optimal” Decision Trees with Bayesian Decision Trees
Proceedings of the AAAI Conference on Artificial Intelligence · 24.03.2024 · 38 (8) · 9019-9026
DOI: 10.1609/aaai.v38i8.28751 ↗Kurz gefasst
Fachartikel in der Zeitschrift Proceedings of the AAAI Conference on Artificial Intelligence, online erschienen am 24.03.2024. Verfasst von Colin Sullivan und 2 weiteren Autor:innen. Die Arbeit wurde bisher 2-mal zitiert (Crossref).
Abstract (Originalsprache)
Decision trees remain one of the most popular machine learning models today, largely due to their out-of-the-box performance and interpretability. In this work, we present a Bayesian approach to decision tree induction via maximum a posteriori inference of a posterior distribution over trees. We first demonstrate a connection between maximum a posteriori inference of decision trees and AND/OR search. Using this connection, we propose an AND/OR search algorithm, dubbed MAPTree, which is able to recover the maximum a posteriori tree. Lastly, we demonstrate the empirical performance of the maximum a posteriori tree both on synthetic data and in real world settings. On 16 real world datasets, MAPTree either outperforms baselines or demonstrates comparable performance but with much smaller trees. On a synthetic dataset, MAPTree also demonstrates greater robustness to noise and better generalization than existing approaches. Finally, MAPTree recovers the maxiumum a posteriori tree faster than existing sampling approaches and, in contrast with those algorithms, is able to provide a certificate of optimality. The code for our experiments is available at https://github.com/ThrunGroup/maptree.
Zitieren
APA
Sullivan, C., Tiwari, M., & Thrun, S. (2024). MAPTree: Beating “Optimal” Decision Trees with Bayesian Decision Trees. Proceedings of the AAAI Conference on Artificial Intelligence, 38(8), 9019-9026. https://doi.org/10.1609/aaai.v38i8.28751
Vancouver
Sullivan C, Tiwari M, Thrun S. MAPTree: Beating “Optimal” Decision Trees with Bayesian Decision Trees. Proceedings of the AAAI Conference on Artificial Intelligence. 2024;38(8):9019-9026. doi:10.1609/aaai.v38i8.28751
BibTeX
@article{Sullivan2024,
author = {Sullivan, Colin and Tiwari, Mo and Thrun, Sebastian},
title = {MAPTree: Beating “Optimal” Decision Trees with Bayesian Decision Trees},
journal = {Proceedings of the AAAI Conference on Artificial Intelligence},
year = {2024},
volume = {38},
number = {8},
pages = {9019--9026},
doi = {10.1609/aaai.v38i8.28751}
}
EUVIMED