EUVIMEDEUVIMED entdecken
KohortenstudieOpen Access

Real-World Impact and Educational Effectiveness of an AI-Powered Medical History-Taking System: Retrospective Propensity Score-Matched Cohort Study

Yang Liu iD, Yiying Zhu iD, Weishan Zhang iD, Xian Lu iD, Liping Wu iD, Minghui Yue iD, Oudong Xia iD, Chujun Shi iD

JMIR Medical Education · 24.02.2026 · 12 · e89367

DOI: 10.2196/89367 ↗

Kurz gefasst

Kohortenstudie in der Zeitschrift JMIR Medical Education, online erschienen am 24.02.2026. Verfasst von Yang Liu und 7 weiteren Autor:innen. Beteiligte Einrichtung: Medical Simulation Center, Shantou University Medical College, Shantou, Guangdong, China. Hauptthemen laut MEDLINE: Medical History Taking, Artificial Intelligence. Die Arbeit wurde bisher 4-mal zitiert (Crossref) und nennt 57 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background

Medical history-taking is a core clinical skill; yet, traditional teaching methods face challenges. We developed an artificial intelligence–powered medical history-taking training and evaluation system (AMTES) and established its technical feasibility as an extracurricular resource. Evidence on whether such tools improve learning outcomes when voluntarily embedded in routine curricula remains limited.

Objective

This study aimed to evaluate the real-world educational effectiveness of AMTES as an opt-in extracurricular tool and examine whether learning gains vary by practice patterns and baseline academic ability.

Methods

We conducted a retrospective cohort study of the 2024-2025 Diagnostics course cohort (N=478) at Shantou University Medical College, China, using total population sampling. Students were categorized as AMTES users (n=205, 42.9%; ≥1 sessions) and nonusers (n=273, 57.1%) based on their voluntary extracurricular adoption of the system during the month preceding a high-stakes final practical skills examination. To address selection bias, we performed 1:1 propensity score matching via logistic regression using age, sex, and 3 previous academic scores as covariates. The average treatment effect on the treated for final examination score (0-70) was estimated with paired t tests, and robustness to unobserved confounding was assessed via Rosenbaum sensitivity analysis. Among matched users, practice patterns were identified using K-means clustering on log-derived features, with cluster differences compared using Mann-Whitney U tests. Subsequently, we explored aptitude-treatment interaction by testing the interaction between practice intensity and baseline ability using linear and logistic regression models.

Results

Propensity score matching yielded 157 matched pairs (n=314) with excellent covariate balance (|standardized mean difference|

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Medical History TakingArtificial IntelligenceHumansRetrospective StudiesPropensity ScoreMaleFemaleCohort StudiesChinaEducational MeasurementAdultClinical Competence

Stichwörter der Autor:innen

AI-powered medical history-taking training and evaluation systemaptitude-treatment interactionaverage treatment effect on the treatededucational effectivenessmedical history-takingprecision educationpropensity score matchingretrospective cohort studyself-regulated learningvirtual patient

Autor:innen und Institutionen

  • Medical Simulation Center, Shantou University Medical College, Shantou, Guangdong, China.
  • Department of Medical Physics and Informatics, Shantou University Medical College, Shantou, Guangdong, China.
  • Shantou University Medical College, Shantou, Guangdong, China.

ORCID-Profile: Yang Liu, Yiying Zhu, Weishan Zhang, Xian Lu, Liping Wu, Minghui Yue, Oudong Xia, Chujun Shi

Zitieren

APA

Liu, Y., Zhu, Y., Zhang, W., Lu, X., Wu, L., Yue, M., Xia, O., & Shi, C. (2026). Real-World Impact and Educational Effectiveness of an AI-Powered Medical History-Taking System: Retrospective Propensity Score-Matched Cohort Study. JMIR Medical Education, 12, e89367. https://doi.org/10.2196/89367

Vancouver

Liu Y, Zhu Y, Zhang W, Lu X, Wu L, Yue M, et al. Real-World Impact and Educational Effectiveness of an AI-Powered Medical History-Taking System: Retrospective Propensity Score-Matched Cohort Study. JMIR Medical Education. 2026;12:e89367. doi:10.2196/89367

BibTeX
@article{Liu2026,
  author = {Liu, Yang and Zhu, Yiying and Zhang, Weishan and Lu, Xian and Wu, Liping and Yue, Minghui and Xia, Oudong and Shi, Chujun},
  title = {Real-World Impact and Educational Effectiveness of an AI-Powered Medical History-Taking System: Retrospective Propensity Score-Matched Cohort Study},
  journal = {JMIR Medical Education},
  year = {2026},
  volume = {12},
  pages = {e89367},
  doi = {10.2196/89367}
}
Kostenlos starten →