EUVIMEDEUVIMED entdecken
Crossref

Selective Forgetting: Advancing Machine Unlearning Techniques and Evaluation in Language Models

Lingzhi Wang, Xingshan Zeng, Jinsong Guo, Kam-Fai Wong, Georg Gottlob

Proceedings of the AAAI Conference on Artificial Intelligence · 11.04.2025 · 39 (1) · 843-851

DOI: 10.1609/aaai.v39i1.32068 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Proceedings of the AAAI Conference on Artificial Intelligence, online erschienen am 11.04.2025. Verfasst von Lingzhi Wang und 4 weiteren Autor:innen. Die Arbeit wurde bisher 17-mal zitiert (Crossref).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

This paper explores Machine Unlearning (MU), an emerging field that is gaining increased attention due to concerns about neural models unintentionally remembering personal or sensitive information. We present SeUL, a novel method that enables selective and fine-grained unlearning for language models. Unlike previous work that employs a fully reversed training objective in unlearning, SeUL minimizes the negative impact on the capability of language models, particularly in terms of generation. Furthermore, we introduce two innovative evaluation metrics, sensitive extraction likelihood (S-EL) and sensitive memorization accuracy (S-MA), specifically designed to assess the effectiveness of forgetting sensitive information. In support of the unlearning framework, we propose efficient automatic online and offline sensitive span annotation methods. The online selection method, based on language probability scores, ensures computational efficiency, while the offline annotation involves a two-stage LLM-based process for robust verification. In summary, this paper contributes a novel selective unlearning method (SeUL), introduces specialized evaluation metrics (S-EL and S-MA) for assessing sensitive information forgetting, and proposes automatic online and offline sensitive span annotation methods to support the overall unlearning framework and evaluation.

Zitieren

APA

Wang, L., Zeng, X., Guo, J., Wong, K., & Gottlob, G. (2025). Selective Forgetting: Advancing Machine Unlearning Techniques and Evaluation in Language Models. Proceedings of the AAAI Conference on Artificial Intelligence, 39(1), 843-851. https://doi.org/10.1609/aaai.v39i1.32068

Vancouver

Wang L, Zeng X, Guo J, Wong K, Gottlob G. Selective Forgetting: Advancing Machine Unlearning Techniques and Evaluation in Language Models. Proceedings of the AAAI Conference on Artificial Intelligence. 2025;39(1):843-851. doi:10.1609/aaai.v39i1.32068

BibTeX
@article{Wang2025,
  author = {Wang, Lingzhi and Zeng, Xingshan and Guo, Jinsong and Wong, Kam-Fai and Gottlob, Georg},
  title = {Selective Forgetting: Advancing Machine Unlearning Techniques and Evaluation in Language Models},
  journal = {Proceedings of the AAAI Conference on Artificial Intelligence},
  year = {2025},
  volume = {39},
  number = {1},
  pages = {843--851},
  doi = {10.1609/aaai.v39i1.32068}
}
Kostenlos starten →