EUVIMEDObjevte EUVIMED
KohortenstudieOpen access

Real-World Impact and Educational Effectiveness of an AI-Powered Medical History-Taking System: Retrospective Propensity Score-Matched Cohort Study

Yang Liu iD, Yiying Zhu iD, Weishan Zhang iD, Xian Lu iD, Liping Wu iD, Minghui Yue iD, Oudong Xia iD, Chujun Shi iD

JMIR Medical Education · 2026-02-24 · 12 · e89367

DOI: 10.2196/89367 ↗

At a glance

Kohortenstudie in JMIR Medical Education, published online on 2026-02-24. Written by Yang Liu and 7 co-authors. Institution: Medical Simulation Center, Shantou University Medical College, Shantou, Guangdong, China. Major MEDLINE topics: Medical History Taking, Artificial Intelligence. Cited 4 times so far (Crossref); 57 references. The full text is freely available in PubMed Central.

AbstraktSubjectsBibliografické údajeCiteRelated studies

Abstract (original language)

Background

Medical history-taking is a core clinical skill; yet, traditional teaching methods face challenges. We developed an artificial intelligence–powered medical history-taking training and evaluation system (AMTES) and established its technical feasibility as an extracurricular resource. Evidence on whether such tools improve learning outcomes when voluntarily embedded in routine curricula remains limited.

Objective

This study aimed to evaluate the real-world educational effectiveness of AMTES as an opt-in extracurricular tool and examine whether learning gains vary by practice patterns and baseline academic ability.

Methods

We conducted a retrospective cohort study of the 2024-2025 Diagnostics course cohort (N=478) at Shantou University Medical College, China, using total population sampling. Students were categorized as AMTES users (n=205, 42.9%; ≥1 sessions) and nonusers (n=273, 57.1%) based on their voluntary extracurricular adoption of the system during the month preceding a high-stakes final practical skills examination. To address selection bias, we performed 1:1 propensity score matching via logistic regression using age, sex, and 3 previous academic scores as covariates. The average treatment effect on the treated for final examination score (0-70) was estimated with paired t tests, and robustness to unobserved confounding was assessed via Rosenbaum sensitivity analysis. Among matched users, practice patterns were identified using K-means clustering on log-derived features, with cluster differences compared using Mann-Whitney U tests. Subsequently, we explored aptitude-treatment interaction by testing the interaction between practice intensity and baseline ability using linear and logistic regression models.

Results

Propensity score matching yielded 157 matched pairs (n=314) with excellent covariate balance (|standardized mean difference|

Subjects

MeSH terms (MEDLINE)

Medical History TakingArtificial IntelligenceHumansRetrospective StudiesPropensity ScoreMaleFemaleCohort StudiesChinaEducational MeasurementAdultClinical Competence

Author keywords

AI-powered medical history-taking training and evaluation systemaptitude-treatment interactionaverage treatment effect on the treatededucational effectivenessmedical history-takingprecision educationpropensity score matchingretrospective cohort studyself-regulated learningvirtual patient

Authors and institutions

  • Medical Simulation Center, Shantou University Medical College, Shantou, Guangdong, China.
  • Department of Medical Physics and Informatics, Shantou University Medical College, Shantou, Guangdong, China.
  • Shantou University Medical College, Shantou, Guangdong, China.

ORCID profiles: Yang Liu, Yiying Zhu, Weishan Zhang, Xian Lu, Liping Wu, Minghui Yue, Oudong Xia, Chujun Shi

Cite

APA

Liu, Y., Zhu, Y., Zhang, W., Lu, X., Wu, L., Yue, M., Xia, O., & Shi, C. (2026). Real-World Impact and Educational Effectiveness of an AI-Powered Medical History-Taking System: Retrospective Propensity Score-Matched Cohort Study. JMIR Medical Education, 12, e89367. https://doi.org/10.2196/89367

Vancouver

Liu Y, Zhu Y, Zhang W, Lu X, Wu L, Yue M, et al. Real-World Impact and Educational Effectiveness of an AI-Powered Medical History-Taking System: Retrospective Propensity Score-Matched Cohort Study. JMIR Medical Education. 2026;12:e89367. doi:10.2196/89367

BibTeX
@article{Liu2026,
  author = {Liu, Yang and Zhu, Yiying and Zhang, Weishan and Lu, Xian and Wu, Liping and Yue, Minghui and Xia, Oudong and Shi, Chujun},
  title = {Real-World Impact and Educational Effectiveness of an AI-Powered Medical History-Taking System: Retrospective Propensity Score-Matched Cohort Study},
  journal = {JMIR Medical Education},
  year = {2026},
  volume = {12},
  pages = {e89367},
  doi = {10.2196/89367}
}
Start for free →