EUVIMEDEUVIMED entdecken
Crossref

Machine Learning-Based Detection of Jailbreak and Prompt Injection Attacks in Large Language Models

Soham Sonawane, Anandita Kashyap, Jatin Kushwaha, Diya Sadhu, Vijaya Patil

International Journal of Advanced Research in Science Communication and Technology · 19.11.2026 · 549

DOI: 10.48175/ijarsct-40870 ↗

Kurz gefasst

Fachartikel in der Zeitschrift International Journal of Advanced Research in Science Communication and Technology, online erschienen am 19.11.2026. Verfasst von Soham Sonawane und 4 weiteren Autor:innen. Die Arbeit nennt 11 Literaturangaben.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Large Language Models (LLMs) are now built into many everyday applications, which exposes them to jailbreak and prompt injection attacks that try to override safety rules or hijack the instructions a model follows. This paper presents a machine learning framework that screens prompts and flags likely malicious ones before they reach the model. We compare Logistic Regression, a Linear Support Vector Machine (SVM) and a fine-tuned DistilBERT classifier on a combined dataset of 24,530 prompts drawn from GuardrailsAI and Neuralchemy, prepared through label normalization, duplicate checking and stratified splitting. After the decision threshold was tuned on validation data, DistilBERT reached 95.56% accuracy, 93.74% precision, 88.77% recall and a 91.18% F1-score on the held-out test set. On a separate collection of 300 JailbreakBench-associated prompts, however, accuracy fell to about 82% and 55 of 200 attack prompts went undetected, which shows how much harder diverse adversarial inputs are than in-distribution data. The results suggest that transformer-based screening can serve as a useful additional security layer for LLM applications, provided it is validated on external benchmarks and combined with other defences.

Zitieren

APA

Sonawane, S., Kashyap, A., Kushwaha, J., Sadhu, D., & Patil, V. (2026). Machine Learning-Based Detection of Jailbreak and Prompt Injection Attacks in Large Language Models. International Journal of Advanced Research in Science Communication and Technology, 549. https://doi.org/10.48175/ijarsct-40870

Vancouver

Sonawane S, Kashyap A, Kushwaha J, Sadhu D, Patil V. Machine Learning-Based Detection of Jailbreak and Prompt Injection Attacks in Large Language Models. International Journal of Advanced Research in Science Communication and Technology. 2026:549. doi:10.48175/ijarsct-40870

BibTeX
@article{Sonawane2026,
  author = {Sonawane, Soham and Kashyap, Anandita and Kushwaha, Jatin and Sadhu, Diya and Patil, Vijaya},
  title = {Machine Learning-Based Detection of Jailbreak and Prompt Injection Attacks in Large Language Models},
  journal = {International Journal of Advanced Research in Science Communication and Technology},
  year = {2026},
  pages = {549},
  doi = {10.48175/ijarsct-40870}
}
Kostenlos starten →