EUVIMEDObjevte EUVIMED
Open access

Assessing Revisit Risk in Emergency Department Patients: Machine Learning Approach

Wang-Chuan Juang, Zheng-Xun Cai, Chia-Mei Chen, Zhi-Hong You

JMIR AI · 2025-08-07 · 4 · e74053-e74053

DOI: 10.2196/74053 ↗

At a glance

Journal article in JMIR AI, published online on 2025-08-07. Written by Wang-Chuan Juang and 3 co-authors. Institution: Quality Management Center, Kaohsiung Veterans General Hospital, No.386, Dazhong 1st Rd., Zuoying Dist., Kaohsiung, 813414, Taiwan, 886 7-342-2121 ext…. Cited 5 times so far (Crossref); 16 references. The full text is freely available in PubMed Central.

AbstraktSubjectsBibliografické údajeCiteRelated studies

Abstract (original language)

Background

Overcrowded emergency rooms might degrade the quality of care and overload the clinic staff. Assessing unscheduled return visits (URVs) to the emergency department (ED) is a quality assurance procedure to identify ED-discharged patients with a high likelihood of bounce-back, to ensure patient safety, and ultimately to reduce medical costs by decreasing the frequency of URVs. The field of machine learning (ML) has evolved considerably in the past decades, and many ML applications have been deployed in various contexts.

Objective

This study aims to develop an ML-assisted framework that identifies high-risk patients who may revisit the ED within 72 hours after the initial visit. Furthermore, this study evaluates different ML models, feature sets, and feature encoding methods in order to build an effective prediction model.

Methods

This study proposes an ML-assisted system that extracts the features from both structured and unstructured medical data to predict patients who are likely to revisit the ED, where the structured data includes patients’ electronic health records, and the unstructured data is their medical notes (subjective, objective, assessment, and plan). A 5-year dataset consisting of 184,687 ED visits, along with 324,111 historical electronic health records and the associated medical notes, was obtained from Kaohsiung Veterans General Hospital, a tertiary medical center in Taiwan, to evaluate the proposed system.

Results

The evaluation results indicate that incorporating convolutional neural network–based feature extraction from unstructured ED physician narrative notes, combined with structured vital signs and demographic data, significantly enhances predictive performance. The proposed approach achieves an area under the receiver operating characteristic curve of 0.705 and a recall of 0.718, demonstrating its effectiveness in predicting URVs. These findings highlight the potential of integrating structured and unstructured clinical data to improve predictive accuracy in this context.

Conclusions

The study demonstrates that an ML-assisted framework may be applied as a decision support tool to assist ED clinicians in identifying revisiting patients, although the model’s performance may not be sufficient for clinic implementation. Given the improvement in the area under the receiver operating characteristic curve, the proposed framework should be further explored as a workable decision support tool to pinpoint ED patients with a high risk of revisit and provide them with appropriate and timely care.

Subjects

Author keywords

clinical decision support systemdeep learningelectronic health recordsmachine learningunscheduled return visit

Authors and institutions

  • Quality Management Center, Kaohsiung Veterans General Hospital, No.386, Dazhong 1st Rd., Zuoying Dist., Kaohsiung, 813414, Taiwan, 886 7-342-2121 ext 4191.
  • Department of Business Management, College of Management, National Sun Yat-sen University, Kaohsiung, Taiwan.
  • Department of Health-Business Administration, Fooyin University, Kaohsiung, Taiwan.
  • Department of Information Management, College of Management, National Sun Yat-sen University, Kaohsiung, Taiwan.

Cite

APA

Juang, W. C., Cai, Z. X., Chen, C. M., & You, Z. H. (2025). Assessing Revisit Risk in Emergency Department Patients: Machine Learning Approach. JMIR AI, 4, e74053-e74053. https://doi.org/10.2196/74053

Vancouver

Juang WC, Cai ZX, Chen CM, You ZH. Assessing Revisit Risk in Emergency Department Patients: Machine Learning Approach. JMIR AI. 2025;4:e74053-e74053. doi:10.2196/74053

BibTeX
@article{Juang2025,
  author = {Juang, Wang-Chuan and Cai, Zheng-Xun and Chen, Chia-Mei and You, Zhi-Hong},
  title = {Assessing Revisit Risk in Emergency Department Patients: Machine Learning Approach},
  journal = {JMIR AI},
  year = {2025},
  volume = {4},
  pages = {e74053--e74053},
  doi = {10.2196/74053}
}
Start for free →