Legal AI in Low-Resource Languages: Building and Evaluating QA Systems for the Kazakh Legislation
Computers · 27.08.2025 · 14 (9) · 354
DOI: 10.3390/computers14090354 ↗Kurz gefasst
Fachartikel in der Zeitschrift Computers, online erschienen am 27.08.2025. Verfasst von Diana Rakhimova und 4 weiteren Autor:innen. Die Arbeit wurde bisher 14-mal zitiert (Crossref) und nennt 67 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Ministry of Science and Higher Education of the Republic of Kazakhstan..
Abstract (Originalsprache)
The research focuses on the development and evaluation of a legal question–answer system for the Kazakh language, a low-resource and morphologically complex language. Four datasets were compiled from open legal sources—Adilet, Zqai, Gov, and a manually created synthetic set—containing question–аnswer pairs extracted from official legislative documents and government portals. Seven large language models (GPT-4o mini, GEMMA, KazLLM, LLaMA, Phi, Qwen, and Mistral) were fine-tuned using structured prompt templates, quantization methods, and domain-specific training to enhance contextual understanding and efficiency. The evaluation employed both automatic metrics (ROUGE and METEOR) and expert-based manual assessment. GPT-4o mini achieved the highest overall performance, with ROUGE-1: 0.309, ROUGE-2: 0.175, ROUGE-L: 0.263, and METEOR: 0.320, and received an expert score of 3.96, indicating strong legal reasoning capabilities and adaptability to Kazakh legal contexts. The results highlight GPT-4o mini’s superiority over other tested models in both quantitative and qualitative evaluations. This work demonstrates the feasibility and importance of developing localized legal AI solutions for low-resource languages, contributing to improved legal accessibility, transparency, and digital governance in Kazakhstan.
Förderung
- Ministry of Science and Higher Education of the Republic of Kazakhstan.
Zitieren
APA
Rakhimova, D., Turarbek, A., Karyukin, V., Sarsenbayeva, A., & Alieyev, R. (2025). Legal AI in Low-Resource Languages: Building and Evaluating QA Systems for the Kazakh Legislation. Computers, 14(9), 354. https://doi.org/10.3390/computers14090354
Vancouver
Rakhimova D, Turarbek A, Karyukin V, Sarsenbayeva A, Alieyev R. Legal AI in Low-Resource Languages: Building and Evaluating QA Systems for the Kazakh Legislation. Computers. 2025;14(9):354. doi:10.3390/computers14090354
BibTeX
@article{Rakhimova2025,
author = {Rakhimova, Diana and Turarbek, Assem and Karyukin, Vladislav and Sarsenbayeva, Assiya and Alieyev, Rashid},
title = {Legal AI in Low-Resource Languages: Building and Evaluating QA Systems for the Kazakh Legislation},
journal = {Computers},
year = {2025},
volume = {14},
number = {9},
pages = {354},
doi = {10.3390/computers14090354}
}
EUVIMED