EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

On-Premises Question Answering for Turkish IT Service Management Tickets: Synthetic Data Generation, QLoRA Fine-Tuning, and NPU-Accelerated Inference—A Preliminary Feasibility Study

Mehmet Akif Özdemir, Hikmetcan Özcan, Meltem Kurt Pehlivanoğlu

Applied Sciences · 28.10.2026 · 16 (21) · 10690

DOI: 10.3390/app162110690 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Applied Sciences, online erschienen am 28.10.2026. Verfasst von Mehmet Akif Özdemir und 2 weiteren Autor:innen. Die Arbeit nennt 44 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Kocaeli University Technopark.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Enterprise information technology (IT) service management (ITSM) requires accurate Turkish-language responses while limiting exposure of sensitive support records. This preliminary feasibility study presents a local, on-premises question-answering workflow that integrates synthetic data generation, quantized low-rank adaptation (QLoRA), multi-method evaluation, and neural processing unit (NPU) inference. From 149,674 IT support records, a local qwen2.5-coder:32b teacher model generated 48,876 question–answer pairs passing automated filters; 48,757 were retained after formatting. The v2 corpus contained more numbered steps (88.7% versus 6.7%) and specific commands (62.5% versus 0.5%) than v1; these descriptive comparisons did not control for experimental generation conditions. Qwen2.5-7B and Qwen2.5-3B were fine-tuned using ticket-grouped training and validation splits to prevent source-ticket overlap. On a ten-scenario benchmark under greedy decoding (without sampling), ROUGE-1 rose from 0.2603 to 0.3763 for the 7B model and from 0.2048 to 0.4010 for the 3B model after fine-tuning. On a 30-question evaluation set (10 benchmark scenarios and 20 validation records), mean G-Eval scores under a shared local judge were 3.78 and 3.76, and pairwise Arena comparisons favored 7B in 15 cases and 3B in 10, with five ties. Following conversion to OpenVINO INT4, single post-warm-up measurements on an Intel Core Ultra 7 366H showed NPU-enabled throughput of 19.3 versus 13.4 tokens/s for 3B and 10.6 versus 7.4 tokens/s for 7B compared with CPU-only inference. Answer correctness was not validated by independent IT experts. These results therefore demonstrate a feasible local workflow only; the small evaluation set, shared teacher and judge model family, structural rather than correctness-based rubric, and single-run hardware measurements limit generalizability.

Förderung

  • Kocaeli University Technopark

Zitieren

APA

Özdemir, M. A., Özcan, H., & Pehlivanoğlu, M. K. (2026). On-Premises Question Answering for Turkish IT Service Management Tickets: Synthetic Data Generation, QLoRA Fine-Tuning, and NPU-Accelerated Inference—A Preliminary Feasibility Study. Applied Sciences, 16(21), 10690. https://doi.org/10.3390/app162110690

Vancouver

Özdemir MA, Özcan H, Pehlivanoğlu MK. On-Premises Question Answering for Turkish IT Service Management Tickets: Synthetic Data Generation, QLoRA Fine-Tuning, and NPU-Accelerated Inference—A Preliminary Feasibility Study. Applied Sciences. 2026;16(21):10690. doi:10.3390/app162110690

BibTeX
@article{zdemir2026,
  author = {Özdemir, Mehmet Akif and Özcan, Hikmetcan and Pehlivanoğlu, Meltem Kurt},
  title = {On-Premises Question Answering for Turkish IT Service Management Tickets: Synthetic Data Generation, QLoRA Fine-Tuning, and NPU-Accelerated Inference—A Preliminary Feasibility Study},
  journal = {Applied Sciences},
  year = {2026},
  volume = {16},
  number = {21},
  pages = {10690},
  doi = {10.3390/app162110690}
}
Kostenlos starten →