EUVIMEDEUVIMED entdecken
Crossref

PrivSV: Differentially Private Steering Vector for Large Language Models

Haocheng Yang, Xiang Cheng, Chenhao Sun, Pengfei Zhang, Sen Su

Proceedings of the AAAI Conference on Artificial Intelligence · 14.03.2026 · 40 (40) · 34241-34249

DOI: 10.1609/aaai.v40i40.40720 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Proceedings of the AAAI Conference on Artificial Intelligence, online erschienen am 14.03.2026. Verfasst von Haocheng Yang und 4 weiteren Autor:innen.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Steering Vector (SV) is a powerful technique for controlling Large Language Models (LLMs) by manipulating their activations without altering model weights. However, when constructed from sensitive data, SV poses significant privacy risks, as it may leak private information. Existing differential privacy (DP) techniques for constructing SV cannot be directly applied to training-based SV construction paradigms, which offer higher task performance. In this work, we present **PrivSV**, a general privacy-preserving approach for constructing SV with DP guarantees, compatible with arbitrary SV construction paradigms while maintaining high utility. In PrivSV, we propose three novel methods: a Layer-wise Noise-Resilient Reduction (LNR²) method to reduce the injected noise in high-dimensional SV; a Directional Prior Compensation (DPC) method to recover utility degraded by noise perturbation; and a Privacy-Aware Optimal Parameter Determination (POPD) method to adaptively maximize the performance of the final compensated SV. Extensive experiments on open-source LLMs of different families (i.e., LlaMa, Qwen, Mistral and Gemma) demonstrate that PrivSV outperforms several existing techniques across various privacy budgets.

Zitieren

APA

Yang, H., Cheng, X., Sun, C., Zhang, P., & Su, S. (2026). PrivSV: Differentially Private Steering Vector for Large Language Models. Proceedings of the AAAI Conference on Artificial Intelligence, 40(40), 34241-34249. https://doi.org/10.1609/aaai.v40i40.40720

Vancouver

Yang H, Cheng X, Sun C, Zhang P, Su S. PrivSV: Differentially Private Steering Vector for Large Language Models. Proceedings of the AAAI Conference on Artificial Intelligence. 2026;40(40):34241-34249. doi:10.1609/aaai.v40i40.40720

BibTeX
@article{Yang2026,
  author = {Yang, Haocheng and Cheng, Xiang and Sun, Chenhao and Zhang, Pengfei and Su, Sen},
  title = {PrivSV: Differentially Private Steering Vector for Large Language Models},
  journal = {Proceedings of the AAAI Conference on Artificial Intelligence},
  year = {2026},
  volume = {40},
  number = {40},
  pages = {34241--34249},
  doi = {10.1609/aaai.v40i40.40720}
}
Kostenlos starten →