EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Legal AI in Low-Resource Languages: Building and Evaluating QA Systems for the Kazakh Legislation

Diana Rakhimova, Assem Turarbek, Vladislav Karyukin, Assiya Sarsenbayeva, Rashid Alieyev

Computers · 27.08.2025 · 14 (9) · 354

DOI: 10.3390/computers14090354 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Computers, online erschienen am 27.08.2025. Verfasst von Diana Rakhimova und 4 weiteren Autor:innen. Die Arbeit wurde bisher 14-mal zitiert (Crossref) und nennt 67 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Ministry of Science and Higher Education of the Republic of Kazakhstan..

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The research focuses on the development and evaluation of a legal question–answer system for the Kazakh language, a low-resource and morphologically complex language. Four datasets were compiled from open legal sources—Adilet, Zqai, Gov, and a manually created synthetic set—containing question–аnswer pairs extracted from official legislative documents and government portals. Seven large language models (GPT-4o mini, GEMMA, KazLLM, LLaMA, Phi, Qwen, and Mistral) were fine-tuned using structured prompt templates, quantization methods, and domain-specific training to enhance contextual understanding and efficiency. The evaluation employed both automatic metrics (ROUGE and METEOR) and expert-based manual assessment. GPT-4o mini achieved the highest overall performance, with ROUGE-1: 0.309, ROUGE-2: 0.175, ROUGE-L: 0.263, and METEOR: 0.320, and received an expert score of 3.96, indicating strong legal reasoning capabilities and adaptability to Kazakh legal contexts. The results highlight GPT-4o mini’s superiority over other tested models in both quantitative and qualitative evaluations. This work demonstrates the feasibility and importance of developing localized legal AI solutions for low-resource languages, contributing to improved legal accessibility, transparency, and digital governance in Kazakhstan.

Förderung

  • Ministry of Science and Higher Education of the Republic of Kazakhstan.

Zitieren

APA

Rakhimova, D., Turarbek, A., Karyukin, V., Sarsenbayeva, A., & Alieyev, R. (2025). Legal AI in Low-Resource Languages: Building and Evaluating QA Systems for the Kazakh Legislation. Computers, 14(9), 354. https://doi.org/10.3390/computers14090354

Vancouver

Rakhimova D, Turarbek A, Karyukin V, Sarsenbayeva A, Alieyev R. Legal AI in Low-Resource Languages: Building and Evaluating QA Systems for the Kazakh Legislation. Computers. 2025;14(9):354. doi:10.3390/computers14090354

BibTeX
@article{Rakhimova2025,
  author = {Rakhimova, Diana and Turarbek, Assem and Karyukin, Vladislav and Sarsenbayeva, Assiya and Alieyev, Rashid},
  title = {Legal AI in Low-Resource Languages: Building and Evaluating QA Systems for the Kazakh Legislation},
  journal = {Computers},
  year = {2025},
  volume = {14},
  number = {9},
  pages = {354},
  doi = {10.3390/computers14090354}
}
Kostenlos starten →