PrivSV: Differentially Private Steering Vector for Large Language Models
Proceedings of the AAAI Conference on Artificial Intelligence · 14.03.2026 · 40 (40) · 34241-34249
DOI: 10.1609/aaai.v40i40.40720 ↗Kurz gefasst
Fachartikel in der Zeitschrift Proceedings of the AAAI Conference on Artificial Intelligence, online erschienen am 14.03.2026. Verfasst von Haocheng Yang und 4 weiteren Autor:innen.
Abstract (Originalsprache)
Steering Vector (SV) is a powerful technique for controlling Large Language Models (LLMs) by manipulating their activations without altering model weights. However, when constructed from sensitive data, SV poses significant privacy risks, as it may leak private information. Existing differential privacy (DP) techniques for constructing SV cannot be directly applied to training-based SV construction paradigms, which offer higher task performance. In this work, we present **PrivSV**, a general privacy-preserving approach for constructing SV with DP guarantees, compatible with arbitrary SV construction paradigms while maintaining high utility. In PrivSV, we propose three novel methods: a Layer-wise Noise-Resilient Reduction (LNR²) method to reduce the injected noise in high-dimensional SV; a Directional Prior Compensation (DPC) method to recover utility degraded by noise perturbation; and a Privacy-Aware Optimal Parameter Determination (POPD) method to adaptively maximize the performance of the final compensated SV. Extensive experiments on open-source LLMs of different families (i.e., LlaMa, Qwen, Mistral and Gemma) demonstrate that PrivSV outperforms several existing techniques across various privacy budgets.
Zitieren
APA
Yang, H., Cheng, X., Sun, C., Zhang, P., & Su, S. (2026). PrivSV: Differentially Private Steering Vector for Large Language Models. Proceedings of the AAAI Conference on Artificial Intelligence, 40(40), 34241-34249. https://doi.org/10.1609/aaai.v40i40.40720
Vancouver
Yang H, Cheng X, Sun C, Zhang P, Su S. PrivSV: Differentially Private Steering Vector for Large Language Models. Proceedings of the AAAI Conference on Artificial Intelligence. 2026;40(40):34241-34249. doi:10.1609/aaai.v40i40.40720
BibTeX
@article{Yang2026,
author = {Yang, Haocheng and Cheng, Xiang and Sun, Chenhao and Zhang, Pengfei and Su, Sen},
title = {PrivSV: Differentially Private Steering Vector for Large Language Models},
journal = {Proceedings of the AAAI Conference on Artificial Intelligence},
year = {2026},
volume = {40},
number = {40},
pages = {34241--34249},
doi = {10.1609/aaai.v40i40.40720}
}
EUVIMED