Evaluating large language models for generating programming questions from code
Pollack Periodica · 09.11.2026 · 21 (3) · 1-9
DOI: 10.1556/606.2025.01471 ↗Kurz gefasst
Fachartikel in der Zeitschrift Pollack Periodica, erschienen am 09.11.2026. Verfasst von Jawad Alshboul und 1 weiteren Autor:innen. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 27 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
E-learning platforms demand effective question-generation methods, and large language models have made this easier. While recent studies focused on generating questions from text, no prior research has evaluated their ability to generate questions from code. This work presents a framework to evaluate the models in question generation from code using average scores, win rates, and Elo ratings. Python, C++, and Java code were used to prompt models. The evaluation includes automatic metrics and human evaluators. Findings show GPT-4-0314, GPT-4-0613, and GPT-3.5-turbo-0613 outperform others, with GPT-4-0314 leading in score (8.86), win rate (1.000), and Elo rating, 2616.
Zitieren
APA
Alshboul, J., & Varga, E. B. (2026). Evaluating large language models for generating programming questions from code. Pollack Periodica, 21(3), 1-9. https://doi.org/10.1556/606.2025.01471
Vancouver
Alshboul J, Varga EB. Evaluating large language models for generating programming questions from code. Pollack Periodica. 2026;21(3):1-9. doi:10.1556/606.2025.01471
BibTeX
@article{Alshboul2026,
author = {Alshboul, Jawad and Varga, Erika Baksáné},
title = {Evaluating large language models for generating programming questions from code},
journal = {Pollack Periodica},
year = {2026},
volume = {21},
number = {3},
pages = {1--9},
doi = {10.1556/606.2025.01471}
}
EUVIMED