EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Multi-task fine-tuning using prefix-prepend format in text-to-text transfer transformer for automatic question generation in Bahasa Indonesia

Halim Wildan Awalurahman, Indra Budi

PeerJ Computer Science · 03.07.2026 · 12 · e3987

DOI: 10.7717/peerj-cs.3987 ↗

Kurz gefasst

Fachartikel in der Zeitschrift PeerJ Computer Science, online erschienen am 03.07.2026. Verfasst von Halim Wildan Awalurahman und 1 weiteren Autor:innen. Die Arbeit nennt 37 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Hibah Penelitian Magister Menuju Doktor Sarjana Unggul, Tokopedia-Universitas Indonesia AI Center of Excellence.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Automatic question generation is one solution to help create test items that require a lot of time and effort. The state-of-the-art model for automatic question generation in Bahasa Indonesia, which uses idT5, has several drawbacks, including misuse of context, overuse of question words, and an answer target that must be exactly from the context, which makes it extractive. This research aims to address those problems by improving the performance of previous models through a new fine-tuning scheme. This research proposed a prefix-prepend format for fine-tuning with the idT5-base model on the Indonesian Stanford Question Answering Dataset (SQuAD) and the Typologically Diverse Question Answering (TyDiQA) dataset. We evaluate the model with Bilingual Evaluation Understudy (BLEU), Recall-Oriented Understudy for Gisting Evaluation (ROUGE), and Bidirectional Encoder Representations from Transformers (BERT) similarity metrics. The results show that prefix-prepend fine-tuning improved the performance of the baseline model. Our best model achieved 0.1643 BLEU, 0.4099 ROUGE-L, and 0.7177 BERT similarity score on SQuAD, and 0.1941 BLEU, 0.4301 ROUGE-L, and 0.7291 BERT similarity score on TyDiQA. The human evaluation using the Content Validation Index (CVI) and a paired t-test indicated that the proposed model performed better than the baseline. While the proposed model addresses many of the baseline’s shortcomings, it still struggles to handle questions that require understanding complex relationships between entities. Future studies can explore improvements for this case using external knowledge or other models.

Förderung

  • Hibah Penelitian Magister Menuju Doktor Sarjana Unggul
  • Tokopedia-Universitas Indonesia AI Center of Excellence

Zitieren

APA

Awalurahman, H. W., & Budi, I. (2026). Multi-task fine-tuning using prefix-prepend format in text-to-text transfer transformer for automatic question generation in Bahasa Indonesia. PeerJ Computer Science, 12, e3987. https://doi.org/10.7717/peerj-cs.3987

Vancouver

Awalurahman HW, Budi I. Multi-task fine-tuning using prefix-prepend format in text-to-text transfer transformer for automatic question generation in Bahasa Indonesia. PeerJ Computer Science. 2026;12:e3987. doi:10.7717/peerj-cs.3987

BibTeX
@article{Awalurahman2026,
  author = {Awalurahman, Halim Wildan and Budi, Indra},
  title = {Multi-task fine-tuning using prefix-prepend format in text-to-text transfer transformer for automatic question generation in Bahasa Indonesia},
  journal = {PeerJ Computer Science},
  year = {2026},
  volume = {12},
  pages = {e3987},
  doi = {10.7717/peerj-cs.3987}
}
Kostenlos starten →