EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

DeepSeek Under Attack: An Analysis of Jailbreak Attacks and Prompt-Level Defenses

Victor Takashi Hayashi, Milton Pedro Pagliuso Neto, Charles Christian Miers, Fernando Frota Redigolo, Reginaldo Arakaki, Marcos Antonio Simplicio

IEEE Access · 2026 · 14 · 103944-103961

DOI: 10.1109/access.2026.3710427 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Access, 2026. Verfasst von Victor Takashi Hayashi und 5 weiteren Autor:innen. Die Arbeit nennt 45 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Laboratório de Arquitetura e Redes de Computadores da Universidade de São Paulo (LARC-USP) and LabP2D/Universidade do Estado de Santa Catarina, Fundação de Amparo à Pesquisa e Inovação do Estado de Santa Catarina, Coordenação de Aperfeiçoamento de Pessoal de Nível Superior–Brazil.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Large Language Models (LLMs) with reasoning capabilities (e.g., DeepSeek-R1) gained substantial research and industry interest. However, their novel reasoning features may introduce vulnerabilities, especially to specific jailbreak attacks that exploit weaknesses in safety alignment. Despite growing awareness of the associated risks in related works, experimental evaluations of defensive mechanisms applied to reasoning models and the comparison with their non-reasoning versions are not yet available in the literature. The objective of this work is to evaluate the security of reasoning model DeepSeek-R1 against jailbreaks, compare it with the non-reasoning model DeepSeek-V3, and assess the effectiveness of two prompt-level defenses: Self-Reminder and Intention Analysis. We used a dataset of 75 jailbreaks with 10 malicious tasks, totaling 750 static attacks. The models were tested in three settings: 1) baseline (i.e., no defense), 2) using Self-Reminder, and 3) using Intention Analysis. Using automated classification with Llama-3.3-70B to measure the Attack Success Rate (ASR), we found that DeepSeek-R1 exhibited a baseline ASR of 70.27%, significantly higher than DeepSeek-V3 (53.47%). Results demonstrate that while Intention Analysis was more effective for DeepSeek-R1 (reducing ASR to 6.00%), Self-Reminder showed greater efficacy for DeepSeek-V3 (reducing ASR to 17.60%). As conclusion, the reasoning model DeepSeek-R1 was more susceptible to jailbreak attacks than the non-reasoning model DeepSeek-V3, and different prompt-level defenses were effective against static jailbreaks. As contributions, this work combines a focused literature review with a empirical evaluation to provide insights into the security of reasoning-based models and the effectiveness of two prompt-level defenses. Warning: this work contains inappropriate language in AI model outputs and jailbreaks.

Förderung

  • Laboratório de Arquitetura e Redes de Computadores da Universidade de São Paulo (LARC-USP) and LabP2D/Universidade do Estado de Santa Catarina
  • Fundação de Amparo à Pesquisa e Inovação do Estado de Santa Catarina
  • Coordenação de Aperfeiçoamento de Pessoal de Nível Superior–Brazil
  • Centro de Pesquisa Aplicada em Inteligência Artificial para a evolução das Indústrias para o Padrão 4.0-Processo FAPESP, Plataforma IAsmin

Zitieren

APA

Hayashi, V. T., Neto, M. P. P., Miers, C. C., Redigolo, F. F., Arakaki, R., & Simplicio, M. A. (2026). DeepSeek Under Attack: An Analysis of Jailbreak Attacks and Prompt-Level Defenses. IEEE Access, 14, 103944-103961. https://doi.org/10.1109/access.2026.3710427

Vancouver

Hayashi VT, Neto MPP, Miers CC, Redigolo FF, Arakaki R, Simplicio MA. DeepSeek Under Attack: An Analysis of Jailbreak Attacks and Prompt-Level Defenses. IEEE Access. 2026;14:103944-103961. doi:10.1109/access.2026.3710427

BibTeX
@article{Hayashi2026,
  author = {Hayashi, Victor Takashi and Neto, Milton Pedro Pagliuso and Miers, Charles Christian and Redigolo, Fernando Frota and Arakaki, Reginaldo and Simplicio, Marcos Antonio},
  title = {DeepSeek Under Attack: An Analysis of Jailbreak Attacks and Prompt-Level Defenses},
  journal = {IEEE Access},
  year = {2026},
  volume = {14},
  pages = {103944--103961},
  doi = {10.1109/access.2026.3710427}
}
Kostenlos starten →