EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Fine-Tuning Generative AI with Domain Question Banks: Evaluating Multi-Type Question Generation and Grading

Chien-Hung Lai, You-Jen Chen, Ze-Ping Chen

Applied Sciences · 11.12.2025 · 15 (24) · 13050

DOI: 10.3390/app152413050 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Applied Sciences, online erschienen am 11.12.2025. Verfasst von Chien-Hung Lai und 2 weiteren Autor:innen. Die Arbeit wurde bisher 4-mal zitiert (Crossref) und nennt 37 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

This study examines the effectiveness of a fine-tuned generative AI system—trained with a domain question bank—for question generation and automated grading in programming education, and evaluates its instructional usability. Methodologically, we constructed an annotated question bank covering nine item types and, under a controlled environment, compared pre- and post-fine-tuning performance on question-type recognition and answer grading using Accuracy, Macro Precision, Macro Recall, and Macro F1. We also collected student questionnaires and open-ended feedback to analyze subjective user experience. Results indicate that the accuracy of question-type recognition improved from 0.6477 to 0.8409, while grading accuracy increased from 0.9474 to 0.9605. Students’ subjective perceptions aligned with these quantitative trends, reporting higher ratings for grading accuracy and question generation quality; overall interactive experience was moderately high, though system speed still requires improvement. These findings provide course-aligned empirical evidence that fine-tuning with domain data can jointly enhance the effectiveness and usability of both automatic question generation and automated grading.

Zitieren

APA

Lai, C., Chen, Y., & Chen, Z. (2025). Fine-Tuning Generative AI with Domain Question Banks: Evaluating Multi-Type Question Generation and Grading. Applied Sciences, 15(24), 13050. https://doi.org/10.3390/app152413050

Vancouver

Lai C, Chen Y, Chen Z. Fine-Tuning Generative AI with Domain Question Banks: Evaluating Multi-Type Question Generation and Grading. Applied Sciences. 2025;15(24):13050. doi:10.3390/app152413050

BibTeX
@article{Lai2025,
  author = {Lai, Chien-Hung and Chen, You-Jen and Chen, Ze-Ping},
  title = {Fine-Tuning Generative AI with Domain Question Banks: Evaluating Multi-Type Question Generation and Grading},
  journal = {Applied Sciences},
  year = {2025},
  volume = {15},
  number = {24},
  pages = {13050},
  doi = {10.3390/app152413050}
}
Kostenlos starten →