EUVIMEDEUVIMED entdecken
Mixed-Methods-StudieOpen Access

A Competency Framework for Medical AI Education: Mixed Methods Study

Chang Cai iD, Gaoxia Zhu iD, Shang-Ming Zhou iD, Olivia Ng iD, Jamie Duell iD, Weng Kin Ho iD, Daisy Minghui Chen iD, Bernett Lee iD, Fang Li iD, Siyuan Liu iD, Vidya Sudarshan iD, Li Rong Wang iD und 2 weitere

JMIR Medical Education · 20.05.2026 · 12 · e91116-e91116

DOI: 10.2196/91116 ↗

Kurz gefasst

Mixed-Methods-Studie in der Zeitschrift JMIR Medical Education, online erschienen am 20.05.2026. Verfasst von Chang Cai und 13 weiteren Autor:innen. Beteiligte Einrichtung: Lee Kong Chian School of Medicine, Nanyang Technological University, 50 Nanyang Avenue, Singapore, Singapore, 65 82634539. Hauptthemen laut MEDLINE: Artificial Intelligence, Education, Medical. Die Arbeit wurde bisher 12-mal zitiert (Crossref) und nennt 64 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background

Although artificial intelligence (AI) is increasingly adopted in health care, clinicians face barriers, including insufficient understanding, limited trust, and challenges in interpreting AI outputs. Existing frameworks, such as the United Nations Educational, Scientific and Cultural Organization (UNESCO) AI competency framework, lack clinical specificity. Additionally, there remains limited evidence on framework-based training programs for medical professionals.

Objective

This study aimed to (1) develop a medical AI competency framework and (2) apply the framework to design an AI training program and pilot 1 module.

Methods

We conducted a mixed methods study comprising 2 phases. In Study 1, we developed a medical AI competency framework by integrating the UNESCO AI framework with the Miller pyramid model. The framework was refined through expert input from 24 stakeholders (6 hospital administrators, 8 medical professionals, and 10 university instructors). Expert responses were analyzed using deductive content analysis based on predefined codebooks. In study 2, we designed an AI training program based on the framework, and evaluated it using a 2-round Delphi process. Nine educators with expertise in instructional design, medical education, and AI participated in the Delphi study. Consensus in round 1 was defined as an IQR≤1, agreement score proportion >75%, and full-score frequency >49.23%; in round 2, consensus was defined as agreement score proportion >80%. A pilot workshop with 28 participants and 4 instructors assessed the feasibility of 1 module using self-reported measures of satisfaction, engagement, and confidence.

Results

A 6D 4-level medical AI competency framework was developed. Among the 24 experts, 19 (79.17%) mentioned competencies related to AI foundations, and 23 (95.83%) mentioned competencies related to application skills. The framework was translated into a 5-module training program, covering patient-centered and ethical AI, privacy and security, medical AI applications, bias and health equity, and generative AI in health care. Each module included 5 elements: content, learning goals, teaching activities, learning resources, and assessment. The Delphi process achieved complete consensus across all 25 elements of the training program. The pilot workshop indicated high participant satisfaction (mean 4.00, SD 0.52), good engagement (mean 3.80, SD 0.71‐mean 4.05, SD 0.51), and moderate self-reported confidence (mean 3.63, SD 0.53). These findings suggest that the module was feasible, although outcomes should be interpreted cautiously given the self-reported and short-term nature of the evaluation.

Conclusions

The framework provides a structured reference for AI training program design in medical education. The workshop findings provide preliminary support for the feasibility of the program’s technical module, while also highlighting the need for broader and longer-term evaluations. Future work should expand the framework and training program to new regions and delivery formats (eg, semester-long courses and continuing medical education) and evaluate their long-term impact.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Artificial IntelligenceEducation, MedicalHumansDelphi TechniqueClinical CompetencePilot Projects

Stichwörter der Autor:innen

AIAI competency frameworkAI literacyAI trainingUNESCOUnited Nations Educational, Scientific and Cultural Organizationartificial intelligencemedical educationmedical professionals

Autor:innen und Institutionen

  • Lee Kong Chian School of Medicine, Nanyang Technological University, 50 Nanyang Avenue, Singapore, Singapore, 65 82634539.
  • National Health Group, Singapore, Singapore.
  • National Institute of Education, Nanyang Technological University, Singapore, Singapore.
  • Center for Health Technology, Faculty of Health, University of Plymouth, Plymouth, United Kingdom.
  • School of Computing and Digital Technologies, Sheffield Hallam University, Sheffield, United Kingdom.
  • Centre of Excellence in AI and Robotics, Sheffield Hallam University, Sheffield, United Kingdom.

ORCID-Profile: Chang Cai, Gaoxia Zhu, Shang-Ming Zhou, Olivia Ng, Jamie Duell, Weng Kin Ho, Daisy Minghui Chen, Bernett Lee, Fang Li, Siyuan Liu, Vidya Sudarshan, Li Rong Wang, Chanwoo Choi, Xiuiyi Fan

Zitieren

APA

Cai, C., Zhu, G., Zhou, S. M., Ng, O., Duell, J., Ho, W. K., Chen, D. M., Lee, B., Li, F., Liu, S., Sudarshan, V., Wang, L. R., Choi, C., & Fan, X. (2026). A Competency Framework for Medical AI Education: Mixed Methods Study. JMIR Medical Education, 12, e91116-e91116. https://doi.org/10.2196/91116

Vancouver

Cai C, Zhu G, Zhou SM, Ng O, Duell J, Ho WK, et al. A Competency Framework for Medical AI Education: Mixed Methods Study. JMIR Medical Education. 2026;12:e91116-e91116. doi:10.2196/91116

BibTeX
@article{Cai2026,
  author = {Cai, Chang and Zhu, Gaoxia and Zhou, Shang-Ming and Ng, Olivia and Duell, Jamie and Ho, Weng Kin and Chen, Daisy Minghui and Lee, Bernett and Li, Fang and Liu, Siyuan and Sudarshan, Vidya and Wang, Li Rong and Choi, Chanwoo and Fan, Xiuiyi},
  title = {A Competency Framework for Medical AI Education: Mixed Methods Study},
  journal = {JMIR Medical Education},
  year = {2026},
  volume = {12},
  pages = {e91116--e91116},
  doi = {10.2196/91116}
}
Kostenlos starten →