EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Comparative evaluation of machine learning methods for protecting LLMs from prompt injection attacks

Nazarii Dzhaliuk, Dmytro Sabodashko, Volodymyr Khoma, Yuriy Khoma, Viktor Kolchenko, Michal Podpora

International Journal of Information Security · 15.06.2026 · 25 (4)

DOI: 10.1007/s10207-026-01264-8 ↗

Kurz gefasst

Fachartikel in der Zeitschrift International Journal of Information Security, online erschienen am 15.06.2026. Verfasst von Nazarii Dzhaliuk und 5 weiteren Autor:innen. Die Arbeit wurde bisher 3-mal zitiert (Crossref) und nennt 33 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Prompt Injection attacks are a significant threat to the security of Large Language Models, giving adversaries the possibility to manipulate model outputs and bypass guardrails and restrictions. This study explores the effectiveness of selected Machine Learning -based approaches in detecting such attacks, comparing four classes of general-purpose and specialized defense approaches. Our empirical evaluation helps to identify and discuss each method, showing that detection effectiveness is strongly dependent on detection strategies and deployment trade-offs in inline defenses. Using a large benchmark of over 300k labeled prompts, selected following a comparison with three additional open-source corpora, we evaluate (1) traditional ML-based classifiers using embeddings, (2) independently fine-tuned encoder-based transformer models (DistilBERT, RoBERTa, DeBERTa), (3) specialized transformer-based detection models pre-trained for Prompt Injection, and (4) general-purpose LLMs configured as classifiers. Our experiments show that fine-tuned models achieve the highest detection rate on balanced benchmarks, traditional ML-based classifiers provide reasonably strong accuracy while requiring less computation, specialized detector models obtain lower recall, and general-purpose LLM-based classifiers can provide competitive performance, depending on the model used. Our research contributes to improving the robustness of AI-driven security systems against Prompt Injection by presenting a comparative study that can help in selecting and deploying ML-based defense against Prompt Injection attacks.

Zitieren

APA

Dzhaliuk, N., Sabodashko, D., Khoma, V., Khoma, Y., Kolchenko, V., & Podpora, M. (2026). Comparative evaluation of machine learning methods for protecting LLMs from prompt injection attacks. International Journal of Information Security, 25(4). https://doi.org/10.1007/s10207-026-01264-8

Vancouver

Dzhaliuk N, Sabodashko D, Khoma V, Khoma Y, Kolchenko V, Podpora M. Comparative evaluation of machine learning methods for protecting LLMs from prompt injection attacks. International Journal of Information Security. 2026;25(4). doi:10.1007/s10207-026-01264-8

BibTeX
@article{Dzhaliuk2026,
  author = {Dzhaliuk, Nazarii and Sabodashko, Dmytro and Khoma, Volodymyr and Khoma, Yuriy and Kolchenko, Viktor and Podpora, Michal},
  title = {Comparative evaluation of machine learning methods for protecting LLMs from prompt injection attacks},
  journal = {International Journal of Information Security},
  year = {2026},
  volume = {25},
  number = {4},
  doi = {10.1007/s10207-026-01264-8}
}
Kostenlos starten →