EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

DeltaBoost: Gradient Boosting Decision Trees with Efficient Machine Unlearning

Zhaomin Wu, Junhui Zhu, Qinbin Li, Bingsheng He

Proceedings of the ACM on Management of Data · 13.06.2023 · 1 (2) · 1-26

DOI: 10.1145/3589313 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Proceedings of the ACM on Management of Data, online erschienen am 20.06.2023. Verfasst von Zhaomin Wu und 3 weiteren Autor:innen. Die Arbeit wurde bisher 18-mal zitiert (Crossref) und nennt 32 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Research Foundation, Singapore.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

As machine learning (ML) has been widely developed in real-world applications, the privacy of ML models draws an increasing concern. In this paper, we study how to forget specific data records from ML models to preserve the privacy of these data. Although some studies propose efficient unlearning algorithms on random forests and extremely randomized trees, Gradient Boosting Decision Trees (GBDT), which are widely used in practice, have not been explored. The efficient unlearning of GBDT faces two major challenges: 1) the training of each tree is deterministic and non-robust; 2) the training of a tree depends on all the previous trees. To solve the first challenge, we propose a robust GBDT-like ML model DeltaBoost that enables efficient and accurate deletion according to our theoretical analysis. For the second challenge, we design a training algorithm for DeltaBoost that minimizes the dependency among trees. Our experiments on five datasets demonstrate that DeltaBoost can remove data records from the trained model efficiently and effectively. Our unlearning approach achieves up to two orders of magnitude speedup compared to retraining GBDT. Besides, DeltaBoost produces competitive performance to existing decision-tree-based ML models.

Förderung

  • National Research Foundation, Singapore

Zitieren

APA

Wu, Z., Zhu, J., Li, Q., & He, B. (2023). DeltaBoost: Gradient Boosting Decision Trees with Efficient Machine Unlearning. Proceedings of the ACM on Management of Data, 1(2), 1-26. https://doi.org/10.1145/3589313

Vancouver

Wu Z, Zhu J, Li Q, He B. DeltaBoost: Gradient Boosting Decision Trees with Efficient Machine Unlearning. Proceedings of the ACM on Management of Data. 2023;1(2):1-26. doi:10.1145/3589313

BibTeX
@article{Wu2023,
  author = {Wu, Zhaomin and Zhu, Junhui and Li, Qinbin and He, Bingsheng},
  title = {DeltaBoost: Gradient Boosting Decision Trees with Efficient Machine Unlearning},
  journal = {Proceedings of the ACM on Management of Data},
  year = {2023},
  volume = {1},
  number = {2},
  pages = {1--26},
  doi = {10.1145/3589313}
}
Kostenlos starten →