EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Machine Unlearning by Reversing the Continual Learning

Yongjing Zhang, Zhaobo Lu, Feng Zhang, Hao Wang, Shaojing Li

Applied Sciences · 17.08.2023 · 13 (16) · 9341

DOI: 10.3390/app13169341 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Applied Sciences, online erschienen am 17.08.2023. Verfasst von Yongjing Zhang und 4 weiteren Autor:innen. Die Arbeit wurde bisher 9-mal zitiert (Crossref) und nennt 29 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Recent legislations, such as the European General Data Protection Regulation (GDPR), require user data holders to guarantee the individual’s right to be forgotten. This means that user data holders must completely delete user data upon request. However, in the field of machine learning, it is not possible to simply remove these data from the back-end database wherein the training dataset is stored, because the machine learning model still retains this data information. Retraining the model using a dataset with these data removed can overcome this problem; however, this can lead to expensive computational overheads. In order to remedy this shortcoming, we propose two effective methods to help model owners or data holders remove private data from a trained model. The first method uses an elastic weight consolidation (EWC) constraint term and a modified loss function to neutralize the data to be removed. The second method approximates the posterior distribution of the model as a Gaussian distribution, and the model after unlearning is computed by decreasingly matching the moment (DMM) of the posterior distribution of the neural network trained on all data and the data to be removed. Finally, we conducted experiments on three standard datasets using backdoor attacks as the evaluation metric. The results show that both methods are effective in removing backdoor triggers in deep learning models. Specifically, EWC can reduce the success rate of backdoor attacks to 0. IMM can ensure that the model prediction accuracy is higher than 80% and keep the success rate of backdoor attacks below 10%.

Zitieren

APA

Zhang, Y., Lu, Z., Zhang, F., Wang, H., & Li, S. (2023). Machine Unlearning by Reversing the Continual Learning. Applied Sciences, 13(16), 9341. https://doi.org/10.3390/app13169341

Vancouver

Zhang Y, Lu Z, Zhang F, Wang H, Li S. Machine Unlearning by Reversing the Continual Learning. Applied Sciences. 2023;13(16):9341. doi:10.3390/app13169341

BibTeX
@article{Zhang2023,
  author = {Zhang, Yongjing and Lu, Zhaobo and Zhang, Feng and Wang, Hao and Li, Shaojing},
  title = {Machine Unlearning by Reversing the Continual Learning},
  journal = {Applied Sciences},
  year = {2023},
  volume = {13},
  number = {16},
  pages = {9341},
  doi = {10.3390/app13169341}
}
Kostenlos starten →