MURI: High-Quality Instruction Tuning Datasets for Low-Resource Languages via Reverse Instructions
Transactions of the Association for Computational Linguistics · 28.08.2025 · 13 · 1032-1055
DOI: 10.1162/tacl.a.18 ↗Kurz gefasst
Fachartikel in der Zeitschrift Transactions of the Association for Computational Linguistics, online erschienen am 28.08.2025. Verfasst von Abdullatif Köksal und 5 weiteren Autor:innen. Die Arbeit wurde bisher 3-mal zitiert (Crossref) und nennt 65 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Instruction tuning enhances large language models (LLMs) by aligning them with human preferences across diverse tasks. Traditional approaches to create instruction tuning datasets face serious challenges for low-resource languages due to their dependence on data annotation. This work introduces a novel method, Multilingual Reverse Instructions (MURI), which generates high-quality instruction tuning datasets for low-resource languages without requiring human annotators or pre-existing multilingual models. Utilizing reverse instructions and a translation pipeline, MURI produces instruction-output pairs from existing human-written texts in low-resource languages. This method ensures cultural relevance and diversity by sourcing texts from different native domains and applying filters to eliminate inappropriate content. Our dataset, MURI-IT, includes more than 2 million instruction-output pairs across 200 languages. Evaluation by native speakers and fine-tuning experiments with mT5 models demonstrate the approach’s effectiveness for both NLU and open-ended generation. We publicly release datasets and models at https://github.com/akoksal/muri.
Zitieren
APA
Köksal, A., Thaler, M., Imani, A., Üstün, A., Korhonen, A., & Schütze, H. (2025). MURI: High-Quality Instruction Tuning Datasets for Low-Resource Languages via Reverse Instructions. Transactions of the Association for Computational Linguistics, 13, 1032-1055. https://doi.org/10.1162/tacl.a.18
Vancouver
Köksal A, Thaler M, Imani A, Üstün A, Korhonen A, Schütze H. MURI: High-Quality Instruction Tuning Datasets for Low-Resource Languages via Reverse Instructions. Transactions of the Association for Computational Linguistics. 2025;13:1032-1055. doi:10.1162/tacl.a.18
BibTeX
@article{Kksal2025,
author = {Köksal, Abdullatif and Thaler, Marion and Imani, Ayyoob and Üstün, Ahmet and Korhonen, Anna and Schütze, Hinrich},
title = {MURI: High-Quality Instruction Tuning Datasets for Low-Resource Languages via Reverse Instructions},
journal = {Transactions of the Association for Computational Linguistics},
year = {2025},
volume = {13},
pages = {1032--1055},
doi = {10.1162/tacl.a.18}
}
EUVIMED