Automatic Detection of Physiological Attributes from Verbal Communication during Time-Critical Medical Events
ACM Transactions on Computing for Healthcare · 2027-01-31 · 8 (1) · 1-25
DOI: 10.1145/3829355 ↗At a glance
Journal article in ACM Transactions on Computing for Healthcare, published online on 2026-11-16. Written by Chenyang Gao and 6 co-authors. Institution: Rutgers, USA. 36 references. The full text is freely available (open access, CC BY 4.0). Funded by: NLM NIH HHS, National Institutes of Health, NSF.
Abstract (original language)
In this study, we present a proof-of-concept system exploring the feasibility of automatically capturing physiological values during the primary survey phase of trauma resuscitation—a complex, time-sensitive evaluation of severely injured patients. We developed and evaluated a speech-driven activity recognition system designed to detect and extract key physiological parameters (e.g., age, manual blood pressure, Glasgow Coma Scale) from spoken clinical dialogue in real-time. By using audio recordings from actual trauma resuscitation cases, our system performs streaming inference to identify verbalized measurements associated with primary survey activities. Experimental results show that our approach can recognize seven attributes with an average accuracy of 72% in a challenging clinical environment with acceptable latency. We present this work as an initial feasibility demonstration rather than a deployment-ready system, highlighting both the opportunities and the remaining challenges of automating documentation in fast-paced emergency environments.
Subjects
Author keywords
Authors and institutions
- Rutgers, USA.
- Division of Trauma and Burn Surgery, Children's National Hospital, USA.
- Drexel, USA.
ORCID profiles: Chenyang Gao, Wenjin Zhang, Aaron H Mun, Aleksandra Sarcevic, Mary S Kim, Randall S Burd, Ivan Marsic
Funding
- NLM NIH HHS
- National Institutes of Health
- NSF
Cite
APA
Gao, C., Zhang, W., Mun, A. H., Sarcevic, A., Kim, M. S., Burd, R. S., & Marsic, I. (2027). Automatic Detection of Physiological Attributes from Verbal Communication during Time-Critical Medical Events. ACM Transactions on Computing for Healthcare, 8(1), 1-25. https://doi.org/10.1145/3829355
Vancouver
Gao C, Zhang W, Mun AH, Sarcevic A, Kim MS, Burd RS, et al. Automatic Detection of Physiological Attributes from Verbal Communication during Time-Critical Medical Events. ACM Transactions on Computing for Healthcare. 2027;8(1):1-25. doi:10.1145/3829355
BibTeX
@article{Gao2027,
author = {Gao, Chenyang and Zhang, Wenjin and Mun, Aaron H and Sarcevic, Aleksandra and Kim, Mary S and Burd, Randall S and Marsic, Ivan},
title = {Automatic Detection of Physiological Attributes from Verbal Communication during Time-Critical Medical Events},
journal = {ACM Transactions on Computing for Healthcare},
year = {2027},
volume = {8},
number = {1},
pages = {1--25},
doi = {10.1145/3829355}
}
EUVIMED