EUVIMEDEUVIMED entdecken
Randomisierte kontrollierte StudieOpen Access

AI-Generated Draft Replies Integrated Into Health Records and Physicians’ Electronic Communication

Ming Tai-Seale, Sally L Baxter, Florin Vaida, Amanda Walker, Amy M Sitapati, Chad Osborne, Joseph Diaz, Nimit Desai, Sophie Webb, Gregory Polston, Teresa Helsten, Erin Gross und 10 weitere

JAMA Network Open · 15.04.2024 · 7 (4) · e246565

DOI: 10.1001/jamanetworkopen.2024.6565 ↗

Kurz gefasst

Randomisierte kontrollierte Studie in der Zeitschrift JAMA Network Open, online erschienen am 15.04.2024. Verfasst von Ming Tai-Seale und 21 weiteren Autor:innen. Beteiligte Einrichtung: Department of Family Medicine, University of California San Diego School of Medicine, La Jolla. Hauptthemen laut MEDLINE: Artificial Intelligence, Physicians. Die Arbeit wurde bisher 165-mal zitiert (Crossref) und nennt 17 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar. Gefördert von: AHRQ HHS.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Importance Timely tests are warranted to assess the association between generative artificial intelligence (GenAI) use and physicians’ work efforts.

Objective

To investigate the association between GenAI-drafted replies for patient messages and physician time spent on answering messages and the length of replies. Design, Setting, and Participants Randomized waiting list quality improvement (QI) study from June to August 2023 in an academic health system. Primary care physicians were randomized to an immediate activation group and a delayed activation group. Data were analyzed from August to November 2023. Exposure Access to GenAI-drafted replies for patient messages. Main Outcomes and Measures Time spent (1) reading messages, (2) replying to messages, (3) length of replies, and (4) physician likelihood to recommend GenAI drafts. The a priori hypothesis was that GenAI drafts would be associated with less physician time spent reading and replying to messages. A mixed-effects model was used.

Results

Fifty-two physicians participated in this QI study, with 25 randomized to the immediate activation group and 27 randomized to the delayed activation group. A contemporary control group included 70 physicians. There were 18 female participants (72.0%) in the immediate group and 17 female participants (63.0%) in the delayed group; the median age range was 35-44 years in the immediate group and 45-54 years in the delayed group. The median (IQR) time spent reading messages in the immediate group was 26 (11-69) seconds at baseline, 31 (15-70) seconds 3 weeks after entry to the intervention, and 31 (14-70) seconds 6 weeks after entry. The delayed group’s median (IQR) read time was 25 (10-67) seconds at baseline, 29 (11-77) seconds during the 3-week waiting period, and 32 (15-72) seconds 3 weeks after entry to the intervention. The contemporary control group’s median (IQR) read times were 21 (9-54), 22 (9-63), and 23 (9-60) seconds in corresponding periods. The estimated association of GenAI was a 21.8% increase in read time (95% CI, 5.2% to 41.0%; P = .008), a −5.9% change in reply time (95% CI, −16.6% to 6.2%; P = .33), and a 17.9% increase in reply length (95% CI, 10.1% to 26.2%; P < .001). Participants recognized GenAI’s value and suggested areas for improvement. Conclusions and Relevance In this QI study, GenAI-drafted replies were associated with significantly increased read time, no change in reply time, significantly increased reply length, and some perceived benefits. Rigorous empirical tests are necessary to further examine GenAI’s performance. Future studies should examine patient experience and compare multiple GenAIs, including those with medical training.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Artificial IntelligencePhysiciansAdultFemaleHumansCommunicationElectronicsMedical Records Systems, ComputerizedMaleMiddle Aged

Autor:innen und Institutionen

  • Department of Family Medicine, University of California San Diego School of Medicine, La Jolla.
  • Department of Medicine, University of California San Diego School of Medicine, La Jolla.
  • Division of Ophthalmology Informatics and Data Science, Viterbi Family Department of Ophthalmology and Shiley Eye Institute, University of California San Diego School of Medicine, La Jolla.
  • Division of Biostatistics, University of California San Diego Herbert Wertheim School of Public Health and Human Longevity Science, La Jolla.
  • University of California San Diego School of Medicine, La Jolla.
  • Department of Anesthesiology, University of California San Diego School of Medicine, La Jolla.

Förderung

  • AHRQ HHS

Zitieren

APA

Tai-Seale, M., Baxter, S. L., Vaida, F., Walker, A., Sitapati, A. M., Osborne, C., Diaz, J., Desai, N., Webb, S., Polston, G., Helsten, T., Gross, E., Thackaberry, J., Mandvi, A., Lillie, D., Li, S., Gin, G., Achar, S., Hofflich, H., …, & Longhurst, C. A. (2024). AI-Generated Draft Replies Integrated Into Health Records and Physicians’ Electronic Communication. JAMA Network Open, 7(4), e246565. https://doi.org/10.1001/jamanetworkopen.2024.6565

Vancouver

Tai-Seale M, Baxter SL, Vaida F, Walker A, Sitapati AM, Osborne C, et al. AI-Generated Draft Replies Integrated Into Health Records and Physicians’ Electronic Communication. JAMA Network Open. 2024;7(4):e246565. doi:10.1001/jamanetworkopen.2024.6565

BibTeX
@article{TaiSeale2024,
  author = {Tai-Seale, Ming and Baxter, Sally L and Vaida, Florin and Walker, Amanda and Sitapati, Amy M and Osborne, Chad and Diaz, Joseph and Desai, Nimit and Webb, Sophie and Polston, Gregory and Helsten, Teresa and Gross, Erin and Thackaberry, Jessica and Mandvi, Ammar and Lillie, Dustin and Li, Steve and Gin, Geneen and Achar, Suraj and Hofflich, Heather and Sharp, Christopher and Millen, Marlene and Longhurst, Christopher A},
  title = {AI-Generated Draft Replies Integrated Into Health Records and Physicians’ Electronic Communication},
  journal = {JAMA Network Open},
  year = {2024},
  volume = {7},
  number = {4},
  pages = {e246565},
  doi = {10.1001/jamanetworkopen.2024.6565}
}
Kostenlos starten →