Selective Forgetting: Advancing Machine Unlearning Techniques and Evaluation in Language Models
Proceedings of the AAAI Conference on Artificial Intelligence · 11.04.2025 · 39 (1) · 843-851
DOI: 10.1609/aaai.v39i1.32068 ↗Kurz gefasst
Fachartikel in der Zeitschrift Proceedings of the AAAI Conference on Artificial Intelligence, online erschienen am 11.04.2025. Verfasst von Lingzhi Wang und 4 weiteren Autor:innen. Die Arbeit wurde bisher 17-mal zitiert (Crossref).
Abstract (Originalsprache)
This paper explores Machine Unlearning (MU), an emerging field that is gaining increased attention due to concerns about neural models unintentionally remembering personal or sensitive information. We present SeUL, a novel method that enables selective and fine-grained unlearning for language models. Unlike previous work that employs a fully reversed training objective in unlearning, SeUL minimizes the negative impact on the capability of language models, particularly in terms of generation. Furthermore, we introduce two innovative evaluation metrics, sensitive extraction likelihood (S-EL) and sensitive memorization accuracy (S-MA), specifically designed to assess the effectiveness of forgetting sensitive information. In support of the unlearning framework, we propose efficient automatic online and offline sensitive span annotation methods. The online selection method, based on language probability scores, ensures computational efficiency, while the offline annotation involves a two-stage LLM-based process for robust verification. In summary, this paper contributes a novel selective unlearning method (SeUL), introduces specialized evaluation metrics (S-EL and S-MA) for assessing sensitive information forgetting, and proposes automatic online and offline sensitive span annotation methods to support the overall unlearning framework and evaluation.
Zitieren
APA
Wang, L., Zeng, X., Guo, J., Wong, K., & Gottlob, G. (2025). Selective Forgetting: Advancing Machine Unlearning Techniques and Evaluation in Language Models. Proceedings of the AAAI Conference on Artificial Intelligence, 39(1), 843-851. https://doi.org/10.1609/aaai.v39i1.32068
Vancouver
Wang L, Zeng X, Guo J, Wong K, Gottlob G. Selective Forgetting: Advancing Machine Unlearning Techniques and Evaluation in Language Models. Proceedings of the AAAI Conference on Artificial Intelligence. 2025;39(1):843-851. doi:10.1609/aaai.v39i1.32068
BibTeX
@article{Wang2025,
author = {Wang, Lingzhi and Zeng, Xingshan and Guo, Jinsong and Wong, Kam-Fai and Gottlob, Georg},
title = {Selective Forgetting: Advancing Machine Unlearning Techniques and Evaluation in Language Models},
journal = {Proceedings of the AAAI Conference on Artificial Intelligence},
year = {2025},
volume = {39},
number = {1},
pages = {843--851},
doi = {10.1609/aaai.v39i1.32068}
}
EUVIMED