EUVIMEDOpdag EUVIMED
Open access · CC BY 4.0

Automatic Detection of Physiological Attributes from Verbal Communication during Time-Critical Medical Events

Chenyang Gao iD, Wenjin Zhang iD, Aaron H Mun iD, Aleksandra Sarcevic iD, Mary S Kim iD, Randall S Burd iD, Ivan Marsic iD

ACM Transactions on Computing for Healthcare · 2027-01-31 · 8 (1) · 1-25

DOI: 10.1145/3829355 ↗

At a glance

Journal article in ACM Transactions on Computing for Healthcare, published online on 2026-11-16. Written by Chenyang Gao and 6 co-authors. Institution: Rutgers, USA. 36 references. The full text is freely available (open access, CC BY 4.0). Funded by: NLM NIH HHS, National Institutes of Health, NSF.

AbstractSubjectsBibliografiske oplysningerCiteRelated studies

Abstract (original language)

In this study, we present a proof-of-concept system exploring the feasibility of automatically capturing physiological values during the primary survey phase of trauma resuscitation—a complex, time-sensitive evaluation of severely injured patients. We developed and evaluated a speech-driven activity recognition system designed to detect and extract key physiological parameters (e.g., age, manual blood pressure, Glasgow Coma Scale) from spoken clinical dialogue in real-time. By using audio recordings from actual trauma resuscitation cases, our system performs streaming inference to identify verbalized measurements associated with primary survey activities. Experimental results show that our approach can recognize seven attributes with an average accuracy of 72% in a challenging clinical environment with acceptable latency. We present this work as an initial feasibility demonstration rather than a deployment-ready system, highlighting both the opportunities and the remaining challenges of automating documentation in fast-paced emergency environments.

Subjects

Author keywords

activity recognitioncase studyphysiological attributes detectionreal-time application

Authors and institutions

  • Rutgers, USA.
  • Division of Trauma and Burn Surgery, Children's National Hospital, USA.
  • Drexel, USA.

ORCID profiles: Chenyang Gao, Wenjin Zhang, Aaron H Mun, Aleksandra Sarcevic, Mary S Kim, Randall S Burd, Ivan Marsic

Funding

  • NLM NIH HHS
  • National Institutes of Health
  • NSF

Cite

APA

Gao, C., Zhang, W., Mun, A. H., Sarcevic, A., Kim, M. S., Burd, R. S., & Marsic, I. (2027). Automatic Detection of Physiological Attributes from Verbal Communication during Time-Critical Medical Events. ACM Transactions on Computing for Healthcare, 8(1), 1-25. https://doi.org/10.1145/3829355

Vancouver

Gao C, Zhang W, Mun AH, Sarcevic A, Kim MS, Burd RS, et al. Automatic Detection of Physiological Attributes from Verbal Communication during Time-Critical Medical Events. ACM Transactions on Computing for Healthcare. 2027;8(1):1-25. doi:10.1145/3829355

BibTeX
@article{Gao2027,
  author = {Gao, Chenyang and Zhang, Wenjin and Mun, Aaron H and Sarcevic, Aleksandra and Kim, Mary S and Burd, Randall S and Marsic, Ivan},
  title = {Automatic Detection of Physiological Attributes from Verbal Communication during Time-Critical Medical Events},
  journal = {ACM Transactions on Computing for Healthcare},
  year = {2027},
  volume = {8},
  number = {1},
  pages = {1--25},
  doi = {10.1145/3829355}
}
Start for free →