EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Large language models in professionalism and ethical decision-making education: a transferable process for generating concordance of professional judgment items

Tuğba İş-Kara iD, Yavuz Selim Kıyak iD

Academic Medicine · 01.10.2026 · 101 (10) · 1248-1252

DOI: 10.1093/acamed/wvag147 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Academic Medicine, online erschienen am 09.05.2026. Verfasst von Tuğba İş-Kara und 1 weiteren Autor:innen. Beteiligte Einrichtung: Department of Medical Education, Graduate School of Health Sciences, Gazi University, Ankara, Turkiye. Hauptthemen laut MEDLINE: Large Language Models, Professionalism, Decision Making, Judgment. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 10 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Problem Concordance-based tools, such as the Concordance of Professional Judgment (CoPJ) tool, allow students to practice ethical decision-making and professionalism under uncertain conditions, but developing high-quality CoPJ items (including writing vignettes and convening expert panels) is resource intensive. Thus, programs often lack the practical infrastructure needed to integrate the CoPJ into curricula at the scale necessary for repeated learner practice. Large language models (LLMs) may help address this burden, but a transferable process to generate CoPJ items aligned with local ethics frameworks and expert oversight is needed. Approach This study implemented and evaluated a transferable process for generating CoPJ items using general purpose LLMs. Using a generic zero-shot prompt, ChatGPT-5 Thinking and Gemini 2.5 Pro were each prompted to generate 1 CoPJ item for all 28 topics in the Turkish Medical Association’s ethical declarations (56 items total) in August 2025. Outcomes Between August and September 2025, 2 faculty reviewers independently rated each LLM-generated item using a 20-criterion checklist and a 4-level global suitability judgment (accepted, minor revision, major revision, rejected), with adjudication as needed. Gemini 2.5 Pro achieved 96.4% overall global suitability, with 27/28 items judged to be suitable (accepted or minor revision). ChatGPT-5 Thinking’s overall global suitability was 89.3% (25/28 items judged to be suitable). Gemini 2.5 Pro had an overall mean checklist success score of 97.5% (19.5/20), and ChatGPT-5 Thinking had a score of 89.0% (17.8/20). Next Steps Future work will examine how LLM-generated CoPJ items function in real learning environments, including a planned learner-based comparison with human-written items. Additional studies across languages, professional programs, and cultural contexts will further help determine the broader adaptability of this process.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Large Language ModelsProfessionalismDecision MakingJudgmentHumansCurriculum

Stichwörter der Autor:innen

ethicslarge language modelslearning by concordancemedical educationprofessionalism

Autor:innen und Institutionen

  • Department of Medical Education, Graduate School of Health Sciences, Gazi University, Ankara, Turkiye.
  • Department of Medical Education and Informatics, Faculty of Medicine, Gazi University, Ankara, Turkiye.

ORCID-Profile: Tuğba İş-Kara, Yavuz Selim Kıyak

Zitieren

APA

İş-Kara, T., & Kıyak, Y. S. (2026). Large language models in professionalism and ethical decision-making education: a transferable process for generating concordance of professional judgment items. Academic Medicine, 101(10), 1248-1252. https://doi.org/10.1093/acamed/wvag147

Vancouver

İş-Kara T, Kıyak YS. Large language models in professionalism and ethical decision-making education: a transferable process for generating concordance of professional judgment items. Academic Medicine. 2026;101(10):1248-1252. doi:10.1093/acamed/wvag147

BibTeX
@article{Kara2026,
  author = {İş-Kara, Tuğba and Kıyak, Yavuz Selim},
  title = {Large language models in professionalism and ethical decision-making education: a transferable process for generating concordance of professional judgment items},
  journal = {Academic Medicine},
  year = {2026},
  volume = {101},
  number = {10},
  pages = {1248--1252},
  doi = {10.1093/acamed/wvag147}
}
Kostenlos starten →