EUVIMEDEUVIMED entdecken
Open Access

A Pilot Study of Medical Student Opinions on Large Language Models

Alan Y Xu, Vincent S Piranio, Skye Speakman, Chelsea D Rosen, Sally Lu, Chris Lamprecht, Robert E Medina, Maisha Corrielus, Ian T Griffin, Corinne E Chatham, Nicolas J Abchee, Daniel Stribling und 4 weitere

Cureus · 20.10.2024

DOI: 10.7759/cureus.71946 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Cureus, erschienen am 20.10.2024. Verfasst von Alan Y Xu und 15 weiteren Autor:innen. Beteiligte Einrichtung: Department of Medicine, University of Florida College of Medicine, Gainesville, USA. Die Arbeit wurde bisher 14-mal zitiert (Crossref) und nennt 20 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Introduction

Artificial intelligence (AI) has long garnered significant interest in the medical field. Large language models (LLMs) have popularized the use of AI for the public through chatbots such as ChatGPT and have become an easily accessible and recognizable medical resource for medical students. Here, we investigate how medical students are currently utilizing LLM-based tools throughout medical education and examine medical student perception of these tools.

Methods

A cross-sectional survey was administered to current medical students at the University of Florida College of Medicine (UFCOM) in January 2024 discussing the utilization of AI and LLM tools and perspectives on the current and future role of AI in medicine.

Results

All 102 respondents reported having heard of LLM-based chatbots such as ChatGPT, Bard, Bing Chat, and Claude. Sixty-nine percent (69%; 70/102) of respondents reported having used them for medical-related purposes at least once a month. Seventy-seven point one percent (77.1%; 54/70) reported the information provided by them to be very accurate or somewhat accurate, and 80% (55/70) reported that they were likely to continue using them in their future medical practice. Those with some baseline understanding of and exposure to AI were 3.26 (p=0.020) and 4.30 (p=0.002) times more likely to have used an LLM-based chatbot, respectively, and 5.06 (p=0.021) and 3.38 (p=0.039) times more likely to cross-check information obtained from them, respectively, compared to those with little to no baseline understanding or exposure. Furthermore, those with some exposure to AI in medical school were 2.70 (p=0.039) and 4.61 (p=0.0004) times more likely to trust AI with clinical decision-making currently and in the next 5 years, respectively, than those with little to no exposure. Those who had used an LLM-based chatbot were 4.31 (p=0.019) times more likely to trust AI with clinical decision-making currently compared to those who had not used one.

Conclusion

LLM-based chatbots, such as ChatGPT, are not only making their way into the medical student repertoire of study resources but are also being utilized in the setting of patient care and research. Medical students who participated in the survey generally had a positive perception of LLM-based chatbots and reported they were likely to continue using them in the future. Previous AI knowledge and exposure correlated with more conscientious use of these tools such as cross-checking information. Combined with our finding that all respondents believed AI should be taught in the medical curriculum, our study highlights a key opportunity in medical education to acclimate medical students to AI now.

Schlagwörter

Stichwörter der Autor:innen

artificial intelligencechatgptlarge language modelmedical educationsurvey

Autor:innen und Institutionen

  • Department of Medicine, University of Florida College of Medicine, Gainesville, USA.
  • Department of Anesthesiology, University of Florida College of Medicine, Gainesville, USA.

Zitieren

APA

Xu, A. Y., Piranio, V. S., Speakman, S., Rosen, C. D., Lu, S., Lamprecht, C., Medina, R. E., Corrielus, M., Griffin, I. T., Chatham, C. E., Abchee, N. J., Stribling, D., Huynh, P. B., Harrell, H., Shickel, B., & Brennan, M. (2024). A Pilot Study of Medical Student Opinions on Large Language Models. Cureus. https://doi.org/10.7759/cureus.71946

Vancouver

Xu AY, Piranio VS, Speakman S, Rosen CD, Lu S, Lamprecht C, et al. A Pilot Study of Medical Student Opinions on Large Language Models. Cureus. 2024. doi:10.7759/cureus.71946

BibTeX
@article{Xu2024,
  author = {Xu, Alan Y and Piranio, Vincent S and Speakman, Skye and Rosen, Chelsea D and Lu, Sally and Lamprecht, Chris and Medina, Robert E and Corrielus, Maisha and Griffin, Ian T and Chatham, Corinne E and Abchee, Nicolas J and Stribling, Daniel and Huynh, Phuong B and Harrell, Heather and Shickel, Benjamin and Brennan, Meghan},
  title = {A Pilot Study of Medical Student Opinions on Large Language Models},
  journal = {Cureus},
  year = {2024},
  doi = {10.7759/cureus.71946}
}
Kostenlos starten →