Development of large language model-generated multiple-choice questions and flashcards to enhance the Canadian undergraduate urology curriculum
Canadian Urological Association Journal · 19.10.2026 · 21 (2)
DOI: 10.5489/cuaj.9845 ↗Kurz gefasst
Fachartikel in der Zeitschrift Canadian Urological Association Journal, online erschienen am 19.10.2026. Verfasst von Othmane Zekraoui und 14 weiteren Autor:innen.
Abstract (Originalsprache)
Introduction
The Canadian Undergraduate Urology Curriculum (CanUUC) is a free, online curriculum that covers important topics in urology for medical students. While multiple-choice questions (MCQs) and flashcards are widely used for medical education, they can be resource-intensive and time-consuming to produce. Therefore, to strengthen the CanUUC with such tools, we developed a customized large language model (LLM)-enabled system to generate MCQs and flashcards from CanUUC material and evaluated the quality of its outputs.
Methods
We used OpenAI’s GPT-5 model and refined two system prompts to generate educational materials from two CanUUC topics (benign prostatic hyperplasia and urolithiasis). Six evaluators blinded to items’ origin were involved, and each item received two independent ratings for relevance, correctness, clarity, distractor quality, and suitability for education. Items with a mean score 1 plausible answer. Across all independent ratings, the proportion of top scores (4–5) ranged from 85.5−90.5% across all domains. Overall, 86.1% of independent ratings judged items suitable for medical education. When averaging the suitability score at the item-level, 12 items (13%) had a score
Zitieren
APA
Zekraoui, O., Li, T., Nguyen, D., Lafontaine, M., Cordoba, T., Moustafa, M., MacLellan, D. L., Letendre, J., Meskawi, M., Chan, G., Neu, S., Elterman, D., Chughtai, B., Wallace, B., & Bhojani, N. (2026). Development of large language model-generated multiple-choice questions and flashcards to enhance the Canadian undergraduate urology curriculum. Canadian Urological Association Journal, 21(2). https://doi.org/10.5489/cuaj.9845
Vancouver
Zekraoui O, Li T, Nguyen D, Lafontaine M, Cordoba T, Moustafa M, et al. Development of large language model-generated multiple-choice questions and flashcards to enhance the Canadian undergraduate urology curriculum. Canadian Urological Association Journal. 2026;21(2). doi:10.5489/cuaj.9845
BibTeX
@article{Zekraoui2026,
author = {Zekraoui, Othmane and Li, Tiange and Nguyen, David-Dan and Lafontaine, Marie-Lyssa and Cordoba, Tomas and Moustafa, Mahmoud and MacLellan, Dawn L. and Letendre, Julien and Meskawi, Malek and Chan, Garson and Neu, Sarah and Elterman, Dean and Chughtai, Bilal and Wallace, Brendan and Bhojani, Naeem},
title = {Development of large language model-generated multiple-choice questions and flashcards to enhance the Canadian undergraduate urology curriculum},
journal = {Canadian Urological Association Journal},
year = {2026},
volume = {21},
number = {2},
doi = {10.5489/cuaj.9845}
}
EUVIMED