EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Safety-Potential Pruning for Enhancing Safety Prompts Against VLM Jailbreaking Without Retraining

Chongxin Li, Hanzhang Wang, Lian Duan

Transactions of the Association for Computational Linguistics · 01.06.2026 · 14 · 1186-1204

DOI: 10.1162/tacl.a.702 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Transactions of the Association for Computational Linguistics, online erschienen am 01.06.2026. Verfasst von Chongxin Li und 2 weiteren Autor:innen. Die Arbeit nennt 58 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Safety prompts constitute an interpretable layer of defense against jailbreak attacks in vision–language models (VLMs); however, their efficacy is constrained by the models’ latent structural responsiveness. We observe that such prompts consistently engage a sparse set of parameters that remain largely quiescent during benign use. This finding motivates the Safety Subnetwork Hypothesis: VLMs embed structurally distinct pathways capable of enforcing safety, but these pathways remain dormant without explicit stimulation. To expose and amplify these pathways, we introduce Safety-Potential Pruning, a one-shot pruning framework that amplifies safety-relevant activations by removing weights that are less responsive to safety prompts without additional retraining. Across three representative VLM architectures and three jailbreak benchmarks, our method reduces attack success rates by up to 22% relative to prompting alone, all while maintaining strong benign performance. These findings frame pruning not only as a model compression technique, but as a structural intervention to emerge alignment-relevant subnets, offering a new path to robust jailbreak resistance.1

Zitieren

APA

Li, C., Wang, H., & Duan, L. (2026). Safety-Potential Pruning for Enhancing Safety Prompts Against VLM Jailbreaking Without Retraining. Transactions of the Association for Computational Linguistics, 14, 1186-1204. https://doi.org/10.1162/tacl.a.702

Vancouver

Li C, Wang H, Duan L. Safety-Potential Pruning for Enhancing Safety Prompts Against VLM Jailbreaking Without Retraining. Transactions of the Association for Computational Linguistics. 2026;14:1186-1204. doi:10.1162/tacl.a.702

BibTeX
@article{Li2026,
  author = {Li, Chongxin and Wang, Hanzhang and Duan, Lian},
  title = {Safety-Potential Pruning for Enhancing Safety Prompts Against VLM Jailbreaking Without Retraining},
  journal = {Transactions of the Association for Computational Linguistics},
  year = {2026},
  volume = {14},
  pages = {1186--1204},
  doi = {10.1162/tacl.a.702}
}
Kostenlos starten →