EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC-ND 4.0

Investigating the threat of AI to undergraduate medical school admissions: a study of its potential impact on the rating of applicant essays

Joshua Choi, Jenny Zhao, Thuy-Anh Ngo, Lawrence Grierson

Canadian Medical Education Journal · 2025

DOI: 10.36834/cmej.79690 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Canadian Medical Education Journal, 2025. Verfasst von Joshua Choi und 3 weiteren Autor:innen. Beteiligte Einrichtung: Department of Family Medicine, Faculty of Health Sciences, McMaster University, Ontario, Canada. Hauptthemen laut MEDLINE: School Admission Criteria, Schools, Medical, Education, Medical, Undergraduate, Writing. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background

Medical school applications often require short written essays or personal statements, which are purportedly used to assess professional qualities related to the practice of medicine. With generative artificial intelligence (AI) tools capable of supplementing or replacing inputs by human applicants, concerns about how these tools impact written assessments are growing. This study explores how AI influences the ratings of essays used for medical school admissions Methods: A within-subject experimental design was employed. Eight participants (academic clinicians, faculty researchers, medical students, and a community member) rated essays written by 24 undergraduate students and recent graduates from McMaster University. The students were divided into four groups: medical school aspirants with AI assistance (ASP-AI), aspirants without AI assistance (ASP), non-aspirants with AI assistance (NASP-AI), and essays generated solely by ChatGPT 3.5 (AI-ONLY). Participants were provided training in the application of single Likert scale tool before rating. Differences in ratings by writer group were determined via one-way between group ANOVA.

Results

Analyses revealed no statistically significant differences in ratings across the four writer groups (p = .358). The intraclass correlation coefficient was .147.

Conclusion

The proliferation of AI adds to prevailing questions about the value personal statements and essays have in supporting applicant selection. We speculate that these assessments hold less value than ever in providing authentic insight into applicant attributes. In this context, we suggest that medical schools move away from the use of essays in their admissions processes.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

School Admission CriteriaSchools, MedicalEducation, Medical, UndergraduateWritingEducational MeasurementArtificial IntelligenceHumansGenerative Artificial IntelligenceStudents, Medical

Autor:innen und Institutionen

  • Department of Family Medicine, Faculty of Health Sciences, McMaster University, Ontario, Canada.
  • Faculty of Health Sciences, McMaster University, Ontario, Canada.
  • Educational Developer, Office of Teaching and Learning, University of Guelph, Ontario, Canada.
  • McMaster Education Research, Innovation and Theory, Faculty of Health Sciences, McMaster University, Ontario, Canada.

Zitieren

APA

Choi, J., Zhao, J., Ngo, T. A., & Grierson, L. (2025). Investigating the threat of AI to undergraduate medical school admissions: a study of its potential impact on the rating of applicant essays. Canadian Medical Education Journal. https://doi.org/10.36834/cmej.79690

Vancouver

Choi J, Zhao J, Ngo TA, Grierson L. Investigating the threat of AI to undergraduate medical school admissions: a study of its potential impact on the rating of applicant essays. Canadian Medical Education Journal. 2025. doi:10.36834/cmej.79690

BibTeX
@article{Choi2025,
  author = {Choi, Joshua and Zhao, Jenny and Ngo, Thuy-Anh and Grierson, Lawrence},
  title = {Investigating the threat of AI to undergraduate medical school admissions: a study of its potential impact on the rating of applicant essays},
  journal = {Canadian Medical Education Journal},
  year = {2025},
  doi = {10.36834/cmej.79690}
}
Kostenlos starten →