Privacy-Preserving Low-Rank Adaptation Against Membership Inference Attacks for Latent Diffusion Models
Proceedings of the AAAI Conference on Artificial Intelligence · 11.04.2025 · 39 (6) · 5883-5891
DOI: 10.1609/aaai.v39i6.32628 ↗Kurz gefasst
Fachartikel in der Zeitschrift Proceedings of the AAAI Conference on Artificial Intelligence, online erschienen am 11.04.2025. Verfasst von Zihao Luo und 5 weiteren Autor:innen. Die Arbeit wurde bisher 4-mal zitiert (Crossref).
Abstract (Originalsprache)
Low-rank adaptation (LoRA) is an efficient strategy for adapting latent diffusion models (LDMs) on a private dataset to generate specific images by minimizing the adaptation loss. However, the LoRA-adapted LDMs are vulnerable to membership inference (MI) attacks that can judge whether a particular data point belongs to the private dataset, thus leading to the privacy leakage. To defend against MI attacks, we first propose a straightforward solution: Membership-Privacy-preserving LoRA (MP-LoRA). MP-LoRA is formulated as a min-max optimization problem where a proxy attack model is trained by maximizing its MI gain while the LDM is adapted by minimizing the sum of the adaptation loss and the MI gain of the proxy attack model. However, we empirically find that MP-LoRA has the issue of unstable optimization, and theoretically analyze that the potential reason is the unconstrained local smoothness, which impedes the privacy-preserving adaptation. To mitigate this issue, we further propose a Stable Membership-Privacy-preserving LoRA (SMP-LoRA) that adapts the LDM by minimizing the ratio of the adaptation loss to the MI gain. Besides, we theoretically prove that the local smoothness of SMP-LoRA can be constrained by the gradient norm, leading to improved convergence. Our experimental results corroborate that SMP-LoRA can indeed defend against MI attacks and generate high-quality images.
Zitieren
APA
Luo, Z., Xu, X., Liu, F., Koh, Y. S., Wang, D., & Zhang, J. (2025). Privacy-Preserving Low-Rank Adaptation Against Membership Inference Attacks for Latent Diffusion Models. Proceedings of the AAAI Conference on Artificial Intelligence, 39(6), 5883-5891. https://doi.org/10.1609/aaai.v39i6.32628
Vancouver
Luo Z, Xu X, Liu F, Koh YS, Wang D, Zhang J. Privacy-Preserving Low-Rank Adaptation Against Membership Inference Attacks for Latent Diffusion Models. Proceedings of the AAAI Conference on Artificial Intelligence. 2025;39(6):5883-5891. doi:10.1609/aaai.v39i6.32628
BibTeX
@article{Luo2025,
author = {Luo, Zihao and Xu, Xilie and Liu, Feng and Koh, Yun Sing and Wang, Di and Zhang, Jingfeng},
title = {Privacy-Preserving Low-Rank Adaptation Against Membership Inference Attacks for Latent Diffusion Models},
journal = {Proceedings of the AAAI Conference on Artificial Intelligence},
year = {2025},
volume = {39},
number = {6},
pages = {5883--5891},
doi = {10.1609/aaai.v39i6.32628}
}
EUVIMED