Investigating the threat of AI to undergraduate medical school admissions: a study of its potential impact on the rating of applicant essays
Canadian Medical Education Journal · 2025
DOI: 10.36834/cmej.79690 ↗Kurz gefasst
Fachartikel in der Zeitschrift Canadian Medical Education Journal, 2025. Verfasst von Joshua Choi und 3 weiteren Autor:innen. Beteiligte Einrichtung: Department of Family Medicine, Faculty of Health Sciences, McMaster University, Ontario, Canada. Hauptthemen laut MEDLINE: School Admission Criteria, Schools, Medical, Education, Medical, Undergraduate, Writing. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0).
Abstract (Originalsprache)
Background
Medical school applications often require short written essays or personal statements, which are purportedly used to assess professional qualities related to the practice of medicine. With generative artificial intelligence (AI) tools capable of supplementing or replacing inputs by human applicants, concerns about how these tools impact written assessments are growing. This study explores how AI influences the ratings of essays used for medical school admissions Methods: A within-subject experimental design was employed. Eight participants (academic clinicians, faculty researchers, medical students, and a community member) rated essays written by 24 undergraduate students and recent graduates from McMaster University. The students were divided into four groups: medical school aspirants with AI assistance (ASP-AI), aspirants without AI assistance (ASP), non-aspirants with AI assistance (NASP-AI), and essays generated solely by ChatGPT 3.5 (AI-ONLY). Participants were provided training in the application of single Likert scale tool before rating. Differences in ratings by writer group were determined via one-way between group ANOVA.
Results
Analyses revealed no statistically significant differences in ratings across the four writer groups (p = .358). The intraclass correlation coefficient was .147.
Conclusion
The proliferation of AI adds to prevailing questions about the value personal statements and essays have in supporting applicant selection. We speculate that these assessments hold less value than ever in providing authentic insight into applicant attributes. In this context, we suggest that medical schools move away from the use of essays in their admissions processes.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Autor:innen und Institutionen
- Department of Family Medicine, Faculty of Health Sciences, McMaster University, Ontario, Canada.
- Faculty of Health Sciences, McMaster University, Ontario, Canada.
- Educational Developer, Office of Teaching and Learning, University of Guelph, Ontario, Canada.
- McMaster Education Research, Innovation and Theory, Faculty of Health Sciences, McMaster University, Ontario, Canada.
Zitieren
APA
Choi, J., Zhao, J., Ngo, T. A., & Grierson, L. (2025). Investigating the threat of AI to undergraduate medical school admissions: a study of its potential impact on the rating of applicant essays. Canadian Medical Education Journal. https://doi.org/10.36834/cmej.79690
Vancouver
Choi J, Zhao J, Ngo TA, Grierson L. Investigating the threat of AI to undergraduate medical school admissions: a study of its potential impact on the rating of applicant essays. Canadian Medical Education Journal. 2025. doi:10.36834/cmej.79690
BibTeX
@article{Choi2025,
author = {Choi, Joshua and Zhao, Jenny and Ngo, Thuy-Anh and Grierson, Lawrence},
title = {Investigating the threat of AI to undergraduate medical school admissions: a study of its potential impact on the rating of applicant essays},
journal = {Canadian Medical Education Journal},
year = {2025},
doi = {10.36834/cmej.79690}
}
EUVIMED