Smartwatch-Measured Clinician Perceptions of Emergency Department Crowding and Their Association With Objective Metrics: Prospective Observational Study
JMIR mHealth and uHealth · 2026-11-10 · 14 · e103317
DOI: 10.2196/103317 ↗At a glance
Beobachtungsstudie in JMIR mHealth and uHealth, published online on 2026-11-10. Written by Ji Sim Yoon and 10 co-authors. Institution: Department of Digital Health, SAIHST, Sungkyunkwan University, Seoul, Republic of Korea. Major MEDLINE topics: Emergency Service, Hospital, Crowding, Perception, Physicians. 46 references.
Abstract (original language)
Background
Emergency department (ED) crowding compromises patient safety and increases clinical workload. Existing crowding metrics capture structural indicators but not how clinicians subjectively experience crowding in real time. Clinician perception may provide a complementary measure.
Objective
This study aimed to examine the concurrent and temporal associations between clinicians’ real-time ED perceived crowding (EDPC), captured via a smartwatch-based ecological momentary assessment (EMA) system, and 3 objective crowding metrics: the ED occupancy ratio (EDOR), the National Emergency Department Overcrowding Score (NEDOCS), and the ED Work Index (EDWIN).
Methods
We conducted a prospective observational study over a continuous 449-hour period (November 25, 2024, 7 AM to December 13, 2024, 11:59 PM) in a single tertiary ED operating under reduced bed capacity and attending-only staffing due to a national physician shortage. We enrolled 28 clinicians (5 attending physicians and 23 charge nurses; mean age 36.3, SD 5.9 years; 21 female and 7 male) by voluntary nonprobability sampling. Clinicians recorded EDPC hourly during active shifts on a continuous 0-200 scale anchored to the NEDOCS crowding categories, from “Not Busy” to “Dangerously Overcrowded.” All valid ratings within each hourly period were aggregated into a single median EDPC value. Interrater agreement was assessed with the Gwet weighted agreement coefficient (AC2) at hourly time points with at least 2 ratings. Main analyses used Pearson correlations between hourly median EDPC and median EDOR, NEDOCS, and EDWIN. Linear mixed-effects models additionally accounted for repeated ratings within clinicians and clustering at the same hourly time point. Time-lagged correlations were exploratory. Statistical significance was set at α=.05.
Results
Across 1124 scheduled on-duty assessment opportunities, clinicians completed 1100 individual EDPC ratings (response rate 1100/1124, 97.86%). These ratings yielded 449 hourly aggregated EDPC observations, with a median of 2 (IQR 2-3; range 1-4) clinicians contributing ratings per hour. Interrater reliability was substantial (AC2=0.742, 95% CI 0.712-0.772). Objective metrics were derived from 1846 ED visits. Hourly median EDPC correlated with median EDOR (r=0.542, 95% CI 0.473-0.604; P
Subjects
MeSH terms (MEDLINE)
Author keywords
Authors and institutions
- Department of Digital Health, SAIHST, Sungkyunkwan University, Seoul, Republic of Korea.
- School of Nursing, University of Virginia, Charlottesville, VA, United States.
- Center for Health Outcomes and Policy Research, School of Nursing, University of Pennsylvania, Philadelphia, PA, United States.
- Departmet of Emergency Medicine, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA, United States.
- Department of Nursing, Samsung Medical Center, Seoul, Republic of Korea.
- Department of Emergency Medicine, Samsung Medical Center, Sungkyunkwan University School of Medicine, Seoul, Republic of Korea.
ORCID profiles: Ji Sim Yoon, Sookyung Park, K Jane Muir, Pamela B DeGuzman, So Yeon Shin, Hansol Chang, Taerim Kim, Se Uk Lee, Sungjun Hong, Won Chul Cha, Junsang Yoo
Cite
APA
Yoon, J. S., Park, S., Muir, K. J., DeGuzman, P. B., Shin, S. Y., Chang, H., Kim, T., Lee, S. U., Hong, S., Cha, W. C., & Yoo, J. (2026). Smartwatch-Measured Clinician Perceptions of Emergency Department Crowding and Their Association With Objective Metrics: Prospective Observational Study. JMIR mHealth and uHealth, 14, e103317. https://doi.org/10.2196/103317
Vancouver
Yoon JS, Park S, Muir KJ, DeGuzman PB, Shin SY, Chang H, et al. Smartwatch-Measured Clinician Perceptions of Emergency Department Crowding and Their Association With Objective Metrics: Prospective Observational Study. JMIR mHealth and uHealth. 2026;14:e103317. doi:10.2196/103317
BibTeX
@article{Yoon2026,
author = {Yoon, Ji Sim and Park, Sookyung and Muir, K Jane and DeGuzman, Pamela B and Shin, So Yeon and Chang, Hansol and Kim, Taerim and Lee, Se Uk and Hong, Sungjun and Cha, Won Chul and Yoo, Junsang},
title = {Smartwatch-Measured Clinician Perceptions of Emergency Department Crowding and Their Association With Objective Metrics: Prospective Observational Study},
journal = {JMIR mHealth and uHealth},
year = {2026},
volume = {14},
pages = {e103317},
doi = {10.2196/103317}
}
EUVIMED