EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Towards automatic question generation using pre-trained model in academic field for Bahasa Indonesia

Derwin Suhartono, Muhammad Rizki Nur Majiid, Renaldy Fredyan

Education and Information Technologies · 2024-11 · 29 (16) · 21295-21330

DOI: 10.1007/s10639-024-12717-9 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Education and Information Technologies, online erschienen am 30.04.2024. Verfasst von Derwin Suhartono und 2 weiteren Autor:innen. Die Arbeit wurde bisher 12-mal zitiert (Crossref) und nennt 59 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Exam evaluations are essential to assessing students’ knowledge and progress in a subject or course. To meet learning objectives and assess student performance, questions must be themed. Automatic Question Generation (AQG) is our novel approach to this problem. A comprehensive process for autonomously generating Bahasa Indonesia text questions is shown. This paper suggests using a decoder to generate text from deep learning models’ tokens. The suggested technique pre-processes Vectorized Corpus, Token IDs, and Features Tensor. The tensors are embedded to increase each token, and attention is masked to separate padding tokens from context-containing tokens. An encoder processes the encoded tokens and attention masks to create a contextual understanding memory that the decoder uses to generate text. Our work uses the Sequence-to-Sequence Learning architecture of BiGRU, BiLSTM, Transformer, BERT, BART, and GPT. Implementing these models optimizes computational resources while extensively exploring the research issue. The model uses context sentences as input and question sentences as output, incorporating linguistic elements like response placement, POS tags, answer masking, and named entities (NE) to improve comprehension and linguistic ability. Our approach includes two innovative models: IndoBERTFormer, which combines a BERT encoder with a Transformer decoder, and IndoBARTFormer, which decodes vectors like BERT. IndoTransGPT uses the Transformer as an encoder to improve understanding, extending the GPT model’s adaptability.

Zitieren

APA

Suhartono, D., Majiid, M. R. N., & Fredyan, R. (2024). Towards automatic question generation using pre-trained model in academic field for Bahasa Indonesia. Education and Information Technologies, 29(16), 21295-21330. https://doi.org/10.1007/s10639-024-12717-9

Vancouver

Suhartono D, Majiid MRN, Fredyan R. Towards automatic question generation using pre-trained model in academic field for Bahasa Indonesia. Education and Information Technologies. 2024;29(16):21295-21330. doi:10.1007/s10639-024-12717-9

BibTeX
@article{Suhartono2024,
  author = {Suhartono, Derwin and Majiid, Muhammad Rizki Nur and Fredyan, Renaldy},
  title = {Towards automatic question generation using pre-trained model in academic field for Bahasa Indonesia},
  journal = {Education and Information Technologies},
  year = {2024},
  volume = {29},
  number = {16},
  pages = {21295--21330},
  doi = {10.1007/s10639-024-12717-9}
}
Kostenlos starten →