Trustworthy Deployment of LLM-Based RAG Systems for Small Businesses: A Security and Confidence-Aware Framework †
Pragmatic Cybersecurity · 2026
DOI: 10.53941/pc.2026.100008 ↗Kurz gefasst
Fachartikel in der Zeitschrift Pragmatic Cybersecurity, 2026. Verfasst von Jiazhu Xie und 4 weiteren Autor:innen. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Small and medium-sized enterprises (SMEs) are increasingly deploying Large Language Model (LLM)-based agentic systems to support customer service and internal knowledge management. However, practical deployment of retrievalaugmented generation (RAG) systems continues to be challenging due to promptinjection risks, unreliable confidence estimation, and limited operational resources in real-world SME environments. This paper presents a secure and confidenceaware deployment framework for SME-oriented RAG systems. The proposed platform integrates layered prompt-injection defences with structured confidenceaware outputs to support more reliable and controlled agentic behaviour during deployment. Rather than treating trustworthiness as a model-level metric, we frame it as a system-level property emerging from the interaction between security filtering, confidence handling, and downstream response control. We evaluate the framework through a real-world e-commerce customer-support deployment operating under realistic SME infrastructure constraints. Experimental results show that the proposed deployment strategy improves prompt-injection robustness while substantially enhancing confidence calibration through structured prompting. The calibrated confidence signals provide useful uncertainty information that may support confidenceaware response handling during deployment. Results across both in-domain and out-ofdomain prompt-injection benchmarks indicate that combining layered security filtering with confidence-aware deployment mechanisms can reduce the risk of overconfident and unsafe responses while remaining practical for lightweight SME infrastructure environments. Experimental results indicate that the proposed deployment pipeline improves prompt-injection robustness while providing more reliable confidence estimates. These improvements were consistently observed across both in-domain and public benchmarks.
Zitieren
APA
Xie, J., Wang, Q., Li, B., Xu, Z., & Han, F. (2026). Trustworthy Deployment of LLM-Based RAG Systems for Small Businesses: A Security and Confidence-Aware Framework †. Pragmatic Cybersecurity. https://doi.org/10.53941/pc.2026.100008
Vancouver
Xie J, Wang Q, Li B, Xu Z, Han F. Trustworthy Deployment of LLM-Based RAG Systems for Small Businesses: A Security and Confidence-Aware Framework †. Pragmatic Cybersecurity. 2026. doi:10.53941/pc.2026.100008
BibTeX
@article{Xie2026,
author = {Xie, Jiazhu and Wang, Qingqing and Li, Bowen and Xu, Ziqi and Han, Fengling},
title = {Trustworthy Deployment of LLM-Based RAG Systems for Small Businesses: A Security and Confidence-Aware Framework †},
journal = {Pragmatic Cybersecurity},
year = {2026},
doi = {10.53941/pc.2026.100008}
}
EUVIMED