EUVIMEDОткрийте EUVIMED
KohortenstudieOpen access

Using Large Language Models to Assess Burnout Among Health Care Workers in the Context of COVID-19 Vaccine Decisions and Health Beliefs: Retrospective Cohort Study

Samaneh Omranian iD, Lu He iD, AkkeNeel Talsma iD, Arielle A J Scoglio iD, Susan McRoy iD, Janet W Rich-Edwards iD

JMIR Nursing · 2025

DOI: 10.2196/73672 ↗

At a glance

Kohortenstudie in JMIR Nursing, 2025. Written by Samaneh Omranian and 5 co-authors. Institution: Brigham and Women's Hospital and Harvard Medical School, Harvard University, Boston, MA, United States. Major MEDLINE topics: COVID-19, Burnout, Professional, Health Personnel, COVID-19 Vaccines. Cited 4 times so far (Crossref); 37 references. The full text is freely available in PubMed Central.

РезюмеSubjectsБиблиографски данниCiteRelated studies

Abstract (original language)

Background

Burnout among health care workers affects their well-being and decision-making, influencing patient and public health outcomes. Health care workers’ health beliefs and COVID-19 vaccine decisions may affect the risks of burnout. Therefore, understanding the interplay between these crucial factors is essential for identifying at-risk staff, providing targeted support, and addressing workplace challenges to prevent further escalation of burnout-related issues.

Objective

This study examines how burnout is impacted by health beliefs and COVID-19 vaccine decisions among health care workers. Building on our previously developed Health Belief Model (HBM) classifier based on the HBM framework, which explains how individual perceptions of health risks and benefits influence behavior, we focused on key HBM constructs, including the perceived severity of COVID-19, perceived barriers to vaccination, and their relationship to burnout. We aim to leverage natural language processing techniques to automatically identify theoretically grounded burnout symptoms from comments authored by nurses in a large-scale, national survey and assess their associations with vaccine hesitancy and health beliefs.

Methods

We analyzed 1944 open-ended comments written by 1501 vaccine-hesitant nurses, using data from the Nurses’ Health Study surveys. We fine-tuned LLaMA 3, an open-source large language model with few-shot prompts and enhanced performance with structured annotation guidance and reasoning-aware inference. Comments were classified into burnout dimensions—Emotional Exhaustion, Depersonalization, and Inefficacy—based on the Maslach Burnout Inventory framework.

Results

The model achieved a high weighted accuracy of 92% and an F 1 -score of 91% for Depersonalization. Emotional Exhaustion was identified in 52% (1003/1944) of comments, correlating strongly with perceived severity (189/323, 59%) and barriers to vaccination (281/650, 43%). Demographic analyses revealed significant variations in burnout prevalence, with older age groups reporting greater burnout.

Conclusions

This study highlights the relationship between burnout and vaccine decision-making among health care workers, uncovering areas for further exploration. By exploring the complex interplay between psychological strain and vaccine hesitancy, this study sets the stage for developing transformative interventions and policies that could redefine workforce resilience and public health strategies.

Subjects

MeSH terms (MEDLINE)

COVID-19Burnout, ProfessionalHealth PersonnelCOVID-19 VaccinesHealth Belief ModelHumansFemaleMaleAdultRetrospective StudiesMiddle AgedSurveys and QuestionnairesDecision MakingLarge Language Models

Author keywords

COVID-19LLMsLLaMAMaslach Burnout Inventoryburnoutfine-tuninghealth beliefs modelhealth care workerslarge language modelsnursesprompt engineeringtext classification

Substances

COVID-19 Vaccines

Authors and institutions

  • Brigham and Women's Hospital and Harvard Medical School, Harvard University, Boston, MA, United States.
  • College of Engineering and Applied Science, University of Wisconsin-Milwaukee, 3200 Cramer Street, Milwaukee, WI, 53211, United States, 1 4142294000.
  • College of Publich Health, University of Wisconsin-Milwaukee, Milwaukee, WI, United States.
  • School of Nursing, University of Wisconsin-Milwaukee, Milwaukee, WI, United States.
  • Department of Natural and Applied Sciences, Bentley University, Waltham, MA, United States.
  • T.H. Chan School of Public Health, Harvard University, Boston, MA, United States.

ORCID profiles: Samaneh Omranian, Lu He, AkkeNeel Talsma, Arielle A J Scoglio, Susan McRoy, Janet W Rich-Edwards

Cite

APA

Omranian, S., He, L., Talsma, A., Scoglio, A. A. J., McRoy, S., & Rich-Edwards, J. W. (2025). Using Large Language Models to Assess Burnout Among Health Care Workers in the Context of COVID-19 Vaccine Decisions and Health Beliefs: Retrospective Cohort Study. JMIR Nursing. https://doi.org/10.2196/73672

Vancouver

Omranian S, He L, Talsma A, Scoglio AAJ, McRoy S, Rich-Edwards JW. Using Large Language Models to Assess Burnout Among Health Care Workers in the Context of COVID-19 Vaccine Decisions and Health Beliefs: Retrospective Cohort Study. JMIR Nursing. 2025. doi:10.2196/73672

BibTeX
@article{Omranian2025,
  author = {Omranian, Samaneh and He, Lu and Talsma, AkkeNeel and Scoglio, Arielle A J and McRoy, Susan and Rich-Edwards, Janet W},
  title = {Using Large Language Models to Assess Burnout Among Health Care Workers in the Context of COVID-19 Vaccine Decisions and Health Beliefs: Retrospective Cohort Study},
  journal = {JMIR Nursing},
  year = {2025},
  doi = {10.2196/73672}
}
Start for free →