A Competency Framework for Medical AI Education: Mixed Methods Study
JMIR Medical Education · 2026-05-20 · 12 · e91116-e91116
DOI: 10.2196/91116 ↗At a glance
Mixed-Methods-Studie in JMIR Medical Education, published online on 2026-05-20. Written by Chang Cai and 13 co-authors. Institution: Lee Kong Chian School of Medicine, Nanyang Technological University, 50 Nanyang Avenue, Singapore, Singapore, 65 82634539. Major MEDLINE topics: Artificial Intelligence, Education, Medical. Cited 12 times so far (Crossref); 64 references. The full text is freely available in PubMed Central.
Abstract (original language)
Background
Although artificial intelligence (AI) is increasingly adopted in health care, clinicians face barriers, including insufficient understanding, limited trust, and challenges in interpreting AI outputs. Existing frameworks, such as the United Nations Educational, Scientific and Cultural Organization (UNESCO) AI competency framework, lack clinical specificity. Additionally, there remains limited evidence on framework-based training programs for medical professionals.
Objective
This study aimed to (1) develop a medical AI competency framework and (2) apply the framework to design an AI training program and pilot 1 module.
Methods
We conducted a mixed methods study comprising 2 phases. In Study 1, we developed a medical AI competency framework by integrating the UNESCO AI framework with the Miller pyramid model. The framework was refined through expert input from 24 stakeholders (6 hospital administrators, 8 medical professionals, and 10 university instructors). Expert responses were analyzed using deductive content analysis based on predefined codebooks. In study 2, we designed an AI training program based on the framework, and evaluated it using a 2-round Delphi process. Nine educators with expertise in instructional design, medical education, and AI participated in the Delphi study. Consensus in round 1 was defined as an IQR≤1, agreement score proportion >75%, and full-score frequency >49.23%; in round 2, consensus was defined as agreement score proportion >80%. A pilot workshop with 28 participants and 4 instructors assessed the feasibility of 1 module using self-reported measures of satisfaction, engagement, and confidence.
Results
A 6D 4-level medical AI competency framework was developed. Among the 24 experts, 19 (79.17%) mentioned competencies related to AI foundations, and 23 (95.83%) mentioned competencies related to application skills. The framework was translated into a 5-module training program, covering patient-centered and ethical AI, privacy and security, medical AI applications, bias and health equity, and generative AI in health care. Each module included 5 elements: content, learning goals, teaching activities, learning resources, and assessment. The Delphi process achieved complete consensus across all 25 elements of the training program. The pilot workshop indicated high participant satisfaction (mean 4.00, SD 0.52), good engagement (mean 3.80, SD 0.71‐mean 4.05, SD 0.51), and moderate self-reported confidence (mean 3.63, SD 0.53). These findings suggest that the module was feasible, although outcomes should be interpreted cautiously given the self-reported and short-term nature of the evaluation.
Conclusions
The framework provides a structured reference for AI training program design in medical education. The workshop findings provide preliminary support for the feasibility of the program’s technical module, while also highlighting the need for broader and longer-term evaluations. Future work should expand the framework and training program to new regions and delivery formats (eg, semester-long courses and continuing medical education) and evaluate their long-term impact.
Subjects
MeSH terms (MEDLINE)
Author keywords
Authors and institutions
- Lee Kong Chian School of Medicine, Nanyang Technological University, 50 Nanyang Avenue, Singapore, Singapore, 65 82634539.
- National Health Group, Singapore, Singapore.
- National Institute of Education, Nanyang Technological University, Singapore, Singapore.
- Center for Health Technology, Faculty of Health, University of Plymouth, Plymouth, United Kingdom.
- School of Computing and Digital Technologies, Sheffield Hallam University, Sheffield, United Kingdom.
- Centre of Excellence in AI and Robotics, Sheffield Hallam University, Sheffield, United Kingdom.
ORCID profiles: Chang Cai, Gaoxia Zhu, Shang-Ming Zhou, Olivia Ng, Jamie Duell, Weng Kin Ho, Daisy Minghui Chen, Bernett Lee, Fang Li, Siyuan Liu, Vidya Sudarshan, Li Rong Wang, Chanwoo Choi, Xiuiyi Fan
Cite
APA
Cai, C., Zhu, G., Zhou, S. M., Ng, O., Duell, J., Ho, W. K., Chen, D. M., Lee, B., Li, F., Liu, S., Sudarshan, V., Wang, L. R., Choi, C., & Fan, X. (2026). A Competency Framework for Medical AI Education: Mixed Methods Study. JMIR Medical Education, 12, e91116-e91116. https://doi.org/10.2196/91116
Vancouver
Cai C, Zhu G, Zhou SM, Ng O, Duell J, Ho WK, et al. A Competency Framework for Medical AI Education: Mixed Methods Study. JMIR Medical Education. 2026;12:e91116-e91116. doi:10.2196/91116
BibTeX
@article{Cai2026,
author = {Cai, Chang and Zhu, Gaoxia and Zhou, Shang-Ming and Ng, Olivia and Duell, Jamie and Ho, Weng Kin and Chen, Daisy Minghui and Lee, Bernett and Li, Fang and Liu, Siyuan and Sudarshan, Vidya and Wang, Li Rong and Choi, Chanwoo and Fan, Xiuiyi},
title = {A Competency Framework for Medical AI Education: Mixed Methods Study},
journal = {JMIR Medical Education},
year = {2026},
volume = {12},
pages = {e91116--e91116},
doi = {10.2196/91116}
}
EUVIMED