A Survey of Clinicians' Views of the Utility of Large Language Models
Applied Clinical Informatics · 2024-03 · 15 (02) · 306-312
DOI: 10.1055/a-2281-7092 ↗Kurz gefasst
Fachartikel in der Zeitschrift Applied Clinical Informatics, online erschienen am 17.04.2024. Verfasst von Matthew Spotnitz und 7 weiteren Autor:innen. Beteiligte Einrichtung: Department of Biomedical Informatics, Columbia University Irving Medical Center, New York, New York, United States. Hauptthemen laut MEDLINE: Artificial Intelligence, Algorithms. Die Arbeit wurde bisher 52-mal zitiert (Crossref) und nennt 24 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0). Gefördert von: NLM NIH HHS, NHGRI NIH HHS, NCATS NIH HHS.
Abstract (Originalsprache)
Objectives
Large language models (LLMs) like Generative pre-trained transformer (ChatGPT) are powerful algorithms that have been shown to produce human-like text from input data. Several potential clinical applications of this technology have been proposed and evaluated by biomedical informatics experts. However, few have surveyed health care providers for their opinions about whether the technology is fit for use.
Methods
We distributed a validated mixed-methods survey to gauge practicing clinicians' comfort with LLMs for a breadth of tasks in clinical practice, research, and education, which were selected from the literature.
Results
A total of 30 clinicians fully completed the survey. Of the 23 tasks, 16 were rated positively by more than 50% of the respondents. Based on our qualitative analysis, health care providers considered LLMs to have excellent synthesis skills and efficiency. However, our respondents had concerns that LLMs could generate false information and propagate training data bias. Our survey respondents were most comfortable with scenarios that allow LLMs to function in an assistive role, like a physician extender or trainee.
Conclusion
In a mixed-methods survey of clinicians about LLM use, health care providers were encouraging of having LLMs in health care for many tasks, and especially in assistive roles. There is a need for continued human-centered development of both LLMs and artificial intelligence in general.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Autor:innen und Institutionen
- Department of Biomedical Informatics, Columbia University Irving Medical Center, New York, New York, United States.
- Department of Dermatology, Vagelos College of Physicians and Surgeons, Columbia University Irving Medical Center, New York, New York, United States.
- Department of Biomedical Informatics and Data Science, Informatics Institute, Heersink School of Medicine, University of Alabama at Birmingham, Birmingham, Alabama, United States.
Förderung
- NLM NIH HHS
- NHGRI NIH HHS
- NCATS NIH HHS
- National Library of Medicine
- National Human Genome Institute
- National Center for Advancing Clinical and Translational Science
- NLM
Zitieren
APA
Spotnitz, M., Idnay, B., Gordon, E. R., Shyu, R., Zhang, G., Liu, C., Cimino, J. J., & Weng, C. (2024). A Survey of Clinicians' Views of the Utility of Large Language Models. Applied Clinical Informatics, 15(02), 306-312. https://doi.org/10.1055/a-2281-7092
Vancouver
Spotnitz M, Idnay B, Gordon ER, Shyu R, Zhang G, Liu C, et al. A Survey of Clinicians' Views of the Utility of Large Language Models. Applied Clinical Informatics. 2024;15(02):306-312. doi:10.1055/a-2281-7092
BibTeX
@article{Spotnitz2024,
author = {Spotnitz, Matthew and Idnay, Betina and Gordon, Emily R and Shyu, Rebecca and Zhang, Gongbo and Liu, Cong and Cimino, James J and Weng, Chunhua},
title = {A Survey of Clinicians' Views of the Utility of Large Language Models},
journal = {Applied Clinical Informatics},
year = {2024},
volume = {15},
number = {02},
pages = {306--312},
doi = {10.1055/a-2281-7092}
}
EUVIMED