EUVIMEDEUVIMED entdecken
Crossref

Memorization in Deep Learning: A Survey

Jiaheng Wei, Yanjun Zhang, Leo Yu Zhang, Ming Ding, Chao Chen, Kok-Leong Ong, Jun Zhang, Yang Xiang

ACM Computing Surveys · 31.03.2026 · 58 (4) · 1-35

DOI: 10.1145/3769076 ↗

Kurz gefasst

Fachartikel in der Zeitschrift ACM Computing Surveys, online erschienen am 25.10.2025. Verfasst von Jiaheng Wei und 7 weiteren Autor:innen. Die Arbeit wurde bisher 13-mal zitiert (Crossref) und nennt 132 Literaturangaben.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Deep Learning (DL) powered by Deep Neural Networks (DNNs) has revolutionized various domains, yet understanding the details of DNN decision-making and learning processes remains a significant challenge. Recent investigations have uncovered an interesting memorization phenomenon in which DNNs tend to memorize specific details from examples rather than learning general patterns, affecting model generalization, security, and privacy. This raises critical questions about the nature of generalization in DNNs and their susceptibility to security breaches. In this survey, we present a systematic framework to organize memorization definitions based on the generalization and security/privacy domains and summarize memorization evaluation methods at both the example and model levels. Through a comprehensive literature review, we explore DNN memorization behaviors and their impacts on security and privacy. We also introduce privacy vulnerabilities caused by memorization and the phenomenon of forgetting and explore its connection with memorization. Furthermore, we spotlight various applications leveraging memorization mechanisms. This survey offers the first-in-kind understanding of memorization in DNNs, providing insights into its challenges and opportunities for enhancing AI development while addressing critical ethical concerns.

Zitieren

APA

Wei, J., Zhang, Y., Zhang, L. Y., Ding, M., Chen, C., Ong, K., Zhang, J., & Xiang, Y. (2026). Memorization in Deep Learning: A Survey. ACM Computing Surveys, 58(4), 1-35. https://doi.org/10.1145/3769076

Vancouver

Wei J, Zhang Y, Zhang LY, Ding M, Chen C, Ong K, et al. Memorization in Deep Learning: A Survey. ACM Computing Surveys. 2026;58(4):1-35. doi:10.1145/3769076

BibTeX
@article{Wei2026,
  author = {Wei, Jiaheng and Zhang, Yanjun and Zhang, Leo Yu and Ding, Ming and Chen, Chao and Ong, Kok-Leong and Zhang, Jun and Xiang, Yang},
  title = {Memorization in Deep Learning: A Survey},
  journal = {ACM Computing Surveys},
  year = {2026},
  volume = {58},
  number = {4},
  pages = {1--35},
  doi = {10.1145/3769076}
}
Kostenlos starten →