EUVIMEDEUVIMED entdecken
Open Access

Eliciting Insights From Chat Logs of the 25X5 Symposium to Reduce Documentation Burden: Novel Application of Topic Modeling

Amanda J Moy iD, Jennifer Withall iD, Mollie Hobensack iD, Rachel Yeji Lee iD, Deborah R Levy iD, Sarah C Rossetti iD, S Trent Rosenbloom iD, Kevin Johnson iD, Kenrick Cato iD

Journal of Medical Internet Research · 2023

DOI: 10.2196/45645 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Medical Internet Research, 2023. Verfasst von Amanda J Moy und 8 weiteren Autor:innen. Beteiligte Einrichtung: Department of Biomedical Informatics, Columbia University, New York, NY, United States. Hauptthemen laut MEDLINE: Delivery of Health Care, Burnout, Professional. Die Arbeit wurde bisher 3-mal zitiert (Crossref) und nennt 56 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar. Gefördert von: NLM NIH HHS, AHRQ HHS, NINR NIH HHS.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background

Addressing clinician documentation burden through “targeted solutions” is a growing priority for many organizations ranging from government and academia to industry. Between January and February 2021, the 25 by 5: Symposium to Reduce Documentation Burden on US Clinicians by 75% (25X5 Symposium) convened across 2 weekly 2-hour sessions among experts and stakeholders to generate actionable goals for reducing clinician documentation over the next 5 years. Throughout this web-based symposium, we passively collected attendees’ contributions to a chat functionality—with their knowledge that the content would be deidentified and made publicly available. This presented a novel opportunity to synthesize and understand participants’ perceptions and interests from chat messages. We performed a content analysis of 25X5 Symposium chat logs to identify themes about reducing clinician documentation burden.

Objective

The objective of this study was to explore unstructured chat log content from the web-based 25X5 Symposium to elicit latent insights on clinician documentation burden among clinicians, health care leaders, and other stakeholders using topic modeling.

Methods

Across the 6 sessions, we captured 1787 messages among 167 unique chat participants cumulatively; 14 were private messages not included in the analysis. We implemented a latent Dirichlet allocation (LDA) topic model on the aggregated dataset to identify clinician documentation burden topics mentioned in the chat logs. Coherence scores and manual examination informed optimal model selection. Next, 5 domain experts independently and qualitatively assigned descriptive labels to model-identified topics and classified them into higher-level categories, which were finalized through a panel consensus.

Results

We uncovered ten topics using the LDA model: (1) determining data and documentation needs (422/1773, 23.8%); (2) collectively reassessing documentation requirements in electronic health records (EHRs) (252/1773, 14.2%); (3) focusing documentation on patient narrative (162/1773, 9.1%); (4) documentation that adds value (147/1773, 8.3%); (5) regulatory impact on clinician burden (142/1773, 8%); (6) improved EHR user interface and design (128/1773, 7.2%); (7) addressing poor usability (122/1773, 6.9%); (8) sharing 25X5 Symposium resources (122/1773, 6.9%); (9) capturing data related to clinician practice (113/1773, 6.4%); and (10) the role of quality measures and technology in burnout (110/1773, 6.2%). Among these 10 topics, 5 high-level categories emerged: consensus building (821/1773, 46.3%), burden sources (365/1773, 20.6%), EHR design (250/1773, 14.1%), patient-centered care (162/1773, 9.1%), and symposium comments (122/1773, 6.9%).

Conclusions

We conducted a topic modeling analysis on 25X5 Symposium multiparticipant chat logs to explore the feasibility of this novel application and elicit additional insights on clinician documentation burden among attendees. Based on the results of our LDA analysis, consensus building, burden sources, EHR design, and patient-centered care may be important themes to consider when addressing clinician documentation burden. Our findings demonstrate the value of topic modeling in discovering topics associated with clinician documentation burden using unstructured textual content. Topic modeling may be a suitable approach to examine latent themes presented in web-based symposium chat logs.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Delivery of Health CareBurnout, ProfessionalHumansElectronic Health RecordsDocumentation

Stichwörter der Autor:innen

burnoutchat botcontent analysisdocumentation burdennursesonline chatphysicianspolicysymposiumtopic modelingvirtual conference

Autor:innen und Institutionen

  • Department of Biomedical Informatics, Columbia University, New York, NY, United States.
  • School of Nursing, Columbia University, New York, NY, United States.
  • School of Medicine, Yale University, New Haven, CT, United States.
  • Veteran's Affairs Connecticut Health Care System, Pain, Research, Informatics, Multi-morbidities Education Center, West Haven, CT, United States.
  • Department of Biomedical Informatics, Vanderbilt University, Nashville, TN, United States.
  • Department of Biostatistics, Epidemiology and Informatics, University of Pennsylvania, Philadelphia, PA, United States.

ORCID-Profile: Amanda J Moy, Jennifer Withall, Mollie Hobensack, Rachel Yeji Lee, Deborah R Levy, Sarah C Rossetti, S Trent Rosenbloom, Kevin Johnson, Kenrick Cato

Förderung

  • NLM NIH HHS
  • AHRQ HHS
  • NINR NIH HHS

Zitieren

APA

Moy, A. J., Withall, J., Hobensack, M., Yeji Lee, R., Levy, D. R., Rossetti, S. C., Rosenbloom, S. T., Johnson, K., & Cato, K. (2023). Eliciting Insights From Chat Logs of the 25X5 Symposium to Reduce Documentation Burden: Novel Application of Topic Modeling. Journal of Medical Internet Research. https://doi.org/10.2196/45645

Vancouver

Moy AJ, Withall J, Hobensack M, Yeji Lee R, Levy DR, Rossetti SC, et al. Eliciting Insights From Chat Logs of the 25X5 Symposium to Reduce Documentation Burden: Novel Application of Topic Modeling. Journal of Medical Internet Research. 2023. doi:10.2196/45645

BibTeX
@article{Moy2023,
  author = {Moy, Amanda J and Withall, Jennifer and Hobensack, Mollie and Yeji Lee, Rachel and Levy, Deborah R and Rossetti, Sarah C and Rosenbloom, S Trent and Johnson, Kevin and Cato, Kenrick},
  title = {Eliciting Insights From Chat Logs of the 25X5 Symposium to Reduce Documentation Burden: Novel Application of Topic Modeling},
  journal = {Journal of Medical Internet Research},
  year = {2023},
  doi = {10.2196/45645}
}
Kostenlos starten →