Enhancing Security and Applicability of Local LLM-Based Document Retrieval Systems in Smart Grid Isolated Environments
Electronics · 27.08.2025 · 14 (17) · 3407
DOI: 10.3390/electronics14173407 ↗Kurz gefasst
Fachartikel in der Zeitschrift Electronics, online erschienen am 27.08.2025. Verfasst von Kiho Lee und 4 weiteren Autor:innen. Die Arbeit wurde bisher 5-mal zitiert (Crossref) und nennt 30 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Human Resources Development Project for Regional Energy Clusters funded by the Ministry of Trade, Industry and Energy in 2025.
Abstract (Originalsprache)
The deployment of large language models (LLMs) in closed-network industrial environments remains constrained by privacy and connectivity limitations. This study presents a retrieval-augmented question-answering system designed to operate entirely offline, integrating local vector embeddings, ontology-based semantic enrichment, and quantized LLMs, while ensuring compliance with industrial security standards like IEC 62351. The system was implemented using OpenChat-3.5 models with two quantization variants (Q5 and Q8), and evaluated through comparative experiments focused on response accuracy, generation speed, and secure document handling. Empirical results show that both quantized models delivered comparable answer quality, with the Q5 variant achieving approximately 1.5 times faster token generation under limited hardware. The ontology-enhanced retriever further improved semantic relevance by incorporating structured domain knowledge into the retrieval stage. Throughout the experiments, the system demonstrated effective performance across speed, accuracy, and information containment—core requirements for AI deployment in security-sensitive domains. These findings underscore the practical viability of offline LLM systems for privacy-compliant document search, while also highlighting architectural considerations essential for extending their utility to environments such as smart grids or defense-critical infrastructures.
Förderung
- Human Resources Development Project for Regional Energy Clusters funded by the Ministry of Trade, Industry and Energy in 2025
Zitieren
APA
Lee, K., Yang, S., Jeong, J., Lee, Y., & Shin, D. (2025). Enhancing Security and Applicability of Local LLM-Based Document Retrieval Systems in Smart Grid Isolated Environments. Electronics, 14(17), 3407. https://doi.org/10.3390/electronics14173407
Vancouver
Lee K, Yang S, Jeong J, Lee Y, Shin D. Enhancing Security and Applicability of Local LLM-Based Document Retrieval Systems in Smart Grid Isolated Environments. Electronics. 2025;14(17):3407. doi:10.3390/electronics14173407
BibTeX
@article{Lee2025,
author = {Lee, Kiho and Yang, Sumi and Jeong, Jaeyeong and Lee, Yongjoon and Shin, Dongkyoo},
title = {Enhancing Security and Applicability of Local LLM-Based Document Retrieval Systems in Smart Grid Isolated Environments},
journal = {Electronics},
year = {2025},
volume = {14},
number = {17},
pages = {3407},
doi = {10.3390/electronics14173407}
}
EUVIMED