EUVIMEDEUVIMED entdecken
Crossref

LoRA-Based Fine-Tuning of Local LLMs for Hallucination Detection in Indonesian RAG Systems

I Ketut Resika Arthana, Nyoman Gunantara, Made Sudarma, Made Sukarsa

International Journal of Advanced Computer Science and Applications · 2026 · 17 (3)

DOI: 10.14569/ijacsa.2026.0170389 ↗

Kurz gefasst

Fachartikel in der Zeitschrift International Journal of Advanced Computer Science and Applications, 2026. Verfasst von I Ketut Resika Arthana und 3 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Retrieval Augmented Generation (RAG) improves the factual grounding of Large Language Models (LLMs) by incorporating external knowledge. However, RAG systems may still generate hallucinated responses, and this issue remains underexplored in Indonesian language settings, particularly in settings where local deployment is preferred. This study proposes a hallucination detection approach for Indonesian RAG systems using Low Rank Adaptation (LoRA) fine-tuning. To support this objective, the study constructs a dataset in the Human-Computer Interaction domain consisting of 908 context, question, and answer pairs. The dataset is classified into four categories: FACT-H, FAITH-H, LOG-H, and FAITHFUL. Three local LLMs, namely, Gemma-7B-it, LlaMA-2-7B chat, and Phi-3-medium-4k-instruct, were evaluated using 5-fold cross-validation. The results show that Gemma-7B-it achieved the best performance in the four-class setting, with a Macro F1 score of 0.846. In the binary classification setting, Gemma achieved an accuracy of 98.1 per cent. Further analysis shows that Gemma was particularly effective in recognizing FAITHFUL, FAITH-H, and FACT-H, while LOG-H remained the most difficult class to distinguish consistently.

Zitieren

APA

Arthana, I. K. R., Gunantara, N., Sudarma, M., & Sukarsa, M. (2026). LoRA-Based Fine-Tuning of Local LLMs for Hallucination Detection in Indonesian RAG Systems. International Journal of Advanced Computer Science and Applications, 17(3). https://doi.org/10.14569/ijacsa.2026.0170389

Vancouver

Arthana IKR, Gunantara N, Sudarma M, Sukarsa M. LoRA-Based Fine-Tuning of Local LLMs for Hallucination Detection in Indonesian RAG Systems. International Journal of Advanced Computer Science and Applications. 2026;17(3). doi:10.14569/ijacsa.2026.0170389

BibTeX
@article{Arthana2026,
  author = {Arthana, I Ketut Resika and Gunantara, Nyoman and Sudarma, Made and Sukarsa, Made},
  title = {LoRA-Based Fine-Tuning of Local LLMs for Hallucination Detection in Indonesian RAG Systems},
  journal = {International Journal of Advanced Computer Science and Applications},
  year = {2026},
  volume = {17},
  number = {3},
  doi = {10.14569/ijacsa.2026.0170389}
}
Kostenlos starten →