LoRA-Based Fine-Tuning of Local LLMs for Hallucination Detection in Indonesian RAG Systems
International Journal of Advanced Computer Science and Applications · 2026 · 17 (3)
DOI: 10.14569/ijacsa.2026.0170389 ↗Kurz gefasst
Fachartikel in der Zeitschrift International Journal of Advanced Computer Science and Applications, 2026. Verfasst von I Ketut Resika Arthana und 3 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref).
Abstract (Originalsprache)
Retrieval Augmented Generation (RAG) improves the factual grounding of Large Language Models (LLMs) by incorporating external knowledge. However, RAG systems may still generate hallucinated responses, and this issue remains underexplored in Indonesian language settings, particularly in settings where local deployment is preferred. This study proposes a hallucination detection approach for Indonesian RAG systems using Low Rank Adaptation (LoRA) fine-tuning. To support this objective, the study constructs a dataset in the Human-Computer Interaction domain consisting of 908 context, question, and answer pairs. The dataset is classified into four categories: FACT-H, FAITH-H, LOG-H, and FAITHFUL. Three local LLMs, namely, Gemma-7B-it, LlaMA-2-7B chat, and Phi-3-medium-4k-instruct, were evaluated using 5-fold cross-validation. The results show that Gemma-7B-it achieved the best performance in the four-class setting, with a Macro F1 score of 0.846. In the binary classification setting, Gemma achieved an accuracy of 98.1 per cent. Further analysis shows that Gemma was particularly effective in recognizing FAITHFUL, FAITH-H, and FACT-H, while LOG-H remained the most difficult class to distinguish consistently.
Zitieren
APA
Arthana, I. K. R., Gunantara, N., Sudarma, M., & Sukarsa, M. (2026). LoRA-Based Fine-Tuning of Local LLMs for Hallucination Detection in Indonesian RAG Systems. International Journal of Advanced Computer Science and Applications, 17(3). https://doi.org/10.14569/ijacsa.2026.0170389
Vancouver
Arthana IKR, Gunantara N, Sudarma M, Sukarsa M. LoRA-Based Fine-Tuning of Local LLMs for Hallucination Detection in Indonesian RAG Systems. International Journal of Advanced Computer Science and Applications. 2026;17(3). doi:10.14569/ijacsa.2026.0170389
BibTeX
@article{Arthana2026,
author = {Arthana, I Ketut Resika and Gunantara, Nyoman and Sudarma, Made and Sukarsa, Made},
title = {LoRA-Based Fine-Tuning of Local LLMs for Hallucination Detection in Indonesian RAG Systems},
journal = {International Journal of Advanced Computer Science and Applications},
year = {2026},
volume = {17},
number = {3},
doi = {10.14569/ijacsa.2026.0170389}
}
EUVIMED