EUVIMEDEUVIMED entdecken
Crossref

TPTh 1.10 Can Evidence-Based Prompting Enable AI to Generate UKMLA-Quality MCQs? A Blinded Evaluation

Arthur Bowers-Barnard, Evripidis Tokidis

British Journal of Surgery · 05.08.2026 · 113 (Supplement_8)

DOI: 10.1093/bjs/znag087.423 ↗

Kurz gefasst

Fachartikel in der Zeitschrift British Journal of Surgery, online erschienen am 05.08.2026. Verfasst von Arthur Bowers-Barnard und 1 weiteren Autor:innen.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Aims

Developing high-quality multiple-choice questions (MCQs) is a time-consuming process that places additional pressure on already stretched clinician-educators. Large language models (LLMs), such as ChatGPT, have demonstrated promise in streamlining MCQ development and optimising the question creation workflow. While emerging evidence suggests that LLM-generated MCQs are comparable to those written by human experts, their suitability for UK Medical Licensing Assessment (UKMLA)–aligned learning has not been established. Furthermore, concerns remain regarding factual accuracy and cognitive depth. This study evaluates whether embedding an evidence-based framework into question generation enables LLMs to produce high-quality MCQs suitable for UKMLA-aligned learning and revision.

Methods

This is an ongoing, blinded, cross-sectional comparative evaluation study. Twenty UKMLA-mapped MCQs generated using ChatGPT and guided by the five A’s of evidence-based medicine will be compared with twenty educator-authored MCQs. Independent consultant experts, blinded to question origin, will evaluate all items. Outcomes will include perceived origin, content validity, educational value and item performance metrics, alongside time taken for question generation.

Results

We predict that ChatGPT-generated MCQs will be comparable to human-authored questions in quality, educational value and item performance, while being produced significantly faster. Experts are expected to be unable to distinguish question origin.

Conclusion

This study will provide evidence on the feasibility of using evidence-informed LLMs to support UKMLA-aligned MCQ development. Findings will help inform the role of AI in medical education, with potential to reduce educator workload while maintaining assessment quality.

Zitieren

APA

Bowers-Barnard, A., & Tokidis, E. (2026). TPTh 1.10 Can Evidence-Based Prompting Enable AI to Generate UKMLA-Quality MCQs? A Blinded Evaluation. British Journal of Surgery, 113(Supplement_8). https://doi.org/10.1093/bjs/znag087.423

Vancouver

Bowers-Barnard A, Tokidis E. TPTh 1.10 Can Evidence-Based Prompting Enable AI to Generate UKMLA-Quality MCQs? A Blinded Evaluation. British Journal of Surgery. 2026;113(Supplement_8). doi:10.1093/bjs/znag087.423

BibTeX
@article{BowersBarnard2026,
  author = {Bowers-Barnard, Arthur and Tokidis, Evripidis},
  title = {TPTh 1.10 Can Evidence-Based Prompting Enable AI to Generate UKMLA-Quality MCQs? A Blinded Evaluation},
  journal = {British Journal of Surgery},
  year = {2026},
  volume = {113},
  number = {Supplement_8},
  doi = {10.1093/bjs/znag087.423}
}
Kostenlos starten →