DeepSeek Under Attack: An Analysis of Jailbreak Attacks and Prompt-Level Defenses
IEEE Access · 2026 · 14 · 103944-103961
DOI: 10.1109/access.2026.3710427 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Access, 2026. Verfasst von Victor Takashi Hayashi und 5 weiteren Autor:innen. Die Arbeit nennt 45 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Laboratório de Arquitetura e Redes de Computadores da Universidade de São Paulo (LARC-USP) and LabP2D/Universidade do Estado de Santa Catarina, Fundação de Amparo à Pesquisa e Inovação do Estado de Santa Catarina, Coordenação de Aperfeiçoamento de Pessoal de Nível Superior–Brazil.
Abstract (Originalsprache)
Large Language Models (LLMs) with reasoning capabilities (e.g., DeepSeek-R1) gained substantial research and industry interest. However, their novel reasoning features may introduce vulnerabilities, especially to specific jailbreak attacks that exploit weaknesses in safety alignment. Despite growing awareness of the associated risks in related works, experimental evaluations of defensive mechanisms applied to reasoning models and the comparison with their non-reasoning versions are not yet available in the literature. The objective of this work is to evaluate the security of reasoning model DeepSeek-R1 against jailbreaks, compare it with the non-reasoning model DeepSeek-V3, and assess the effectiveness of two prompt-level defenses: Self-Reminder and Intention Analysis. We used a dataset of 75 jailbreaks with 10 malicious tasks, totaling 750 static attacks. The models were tested in three settings: 1) baseline (i.e., no defense), 2) using Self-Reminder, and 3) using Intention Analysis. Using automated classification with Llama-3.3-70B to measure the Attack Success Rate (ASR), we found that DeepSeek-R1 exhibited a baseline ASR of 70.27%, significantly higher than DeepSeek-V3 (53.47%). Results demonstrate that while Intention Analysis was more effective for DeepSeek-R1 (reducing ASR to 6.00%), Self-Reminder showed greater efficacy for DeepSeek-V3 (reducing ASR to 17.60%). As conclusion, the reasoning model DeepSeek-R1 was more susceptible to jailbreak attacks than the non-reasoning model DeepSeek-V3, and different prompt-level defenses were effective against static jailbreaks. As contributions, this work combines a focused literature review with a empirical evaluation to provide insights into the security of reasoning-based models and the effectiveness of two prompt-level defenses. Warning: this work contains inappropriate language in AI model outputs and jailbreaks.
Förderung
- Laboratório de Arquitetura e Redes de Computadores da Universidade de São Paulo (LARC-USP) and LabP2D/Universidade do Estado de Santa Catarina
- Fundação de Amparo à Pesquisa e Inovação do Estado de Santa Catarina
- Coordenação de Aperfeiçoamento de Pessoal de Nível Superior–Brazil
- Centro de Pesquisa Aplicada em Inteligência Artificial para a evolução das Indústrias para o Padrão 4.0-Processo FAPESP, Plataforma IAsmin
Zitieren
APA
Hayashi, V. T., Neto, M. P. P., Miers, C. C., Redigolo, F. F., Arakaki, R., & Simplicio, M. A. (2026). DeepSeek Under Attack: An Analysis of Jailbreak Attacks and Prompt-Level Defenses. IEEE Access, 14, 103944-103961. https://doi.org/10.1109/access.2026.3710427
Vancouver
Hayashi VT, Neto MPP, Miers CC, Redigolo FF, Arakaki R, Simplicio MA. DeepSeek Under Attack: An Analysis of Jailbreak Attacks and Prompt-Level Defenses. IEEE Access. 2026;14:103944-103961. doi:10.1109/access.2026.3710427
BibTeX
@article{Hayashi2026,
author = {Hayashi, Victor Takashi and Neto, Milton Pedro Pagliuso and Miers, Charles Christian and Redigolo, Fernando Frota and Arakaki, Reginaldo and Simplicio, Marcos Antonio},
title = {DeepSeek Under Attack: An Analysis of Jailbreak Attacks and Prompt-Level Defenses},
journal = {IEEE Access},
year = {2026},
volume = {14},
pages = {103944--103961},
doi = {10.1109/access.2026.3710427}
}
EUVIMED