EUVIMEDEUVIMED entdecken
Open Access

Evaluating Equity in Usage and Effectiveness of the CONCERN Early Warning System

Rachel Y Lee iD, Kenrick D Cato, Patricia C Dykes, Graham Lowenthal, Haomiao Jia, Temiloluwa Daramola, Sarah C Rossetti

Applied Clinical Informatics · 10.06.2025 · 16 (04) · 838-847

DOI: 10.1055/a-2630-4192 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Applied Clinical Informatics, erschienen am 10.06.2025. Verfasst von Rachel Y Lee und 6 weiteren Autor:innen. Beteiligte Einrichtung: Department of Biomedical Informatics, Columbia University, New York, New York, United States. Hauptthemen laut MEDLINE: Decision Support Systems, Clinical. Die Arbeit wurde bisher 2-mal zitiert (Crossref). Der Volltext ist frei in PubMed Central verfügbar. Gefördert von: American Nurses Foundation.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background

The CONCERN Early Warning System (CONCERN EWS) is an artificial intelligence based clinical decision support system (AI-CDSS) for prediction of clinical deterioration leveraging signals from nursing documentation patterns. While a recent multi-site randomized controlled trial demonstrated its effectiveness in reducing inpatient mortality and length of stay, evaluating implementation outcomes is essential to ensure equitable results across patient populations.

Objectives

1) assess whether clinicians’ usage of the CONCERN EWS, as measured by CONCERN Detailed Prediction Screen launches, varied by patient demographic characteristics, including sex, race, ethnicity, and primary language; 2) evaluate whether CONCERN EWS’s effectiveness in reducing the risk of in-hospital mortality varied across patient demographic groups.

Methods

We conducted a retrospective observational analysis of electronic health records log files and clinical outcomes from a multi-site pragmatic cluster-randomized controlled trial involving four hospitals across two healthcare systems. Equity in usage was assessed by comparing CONCERN Detailed Prediction Screen launches across demographic groups, and effectiveness was examined by comparing the risk of in-hospital mortality between intervention and usual care groups using Cox proportional hazards models adjusted for patient characteristics.

Results

Clinicians’ CONCERN Detailed Prediction Screen launches did not significantly differ by patients’ demographic characteristics, suggesting equitable usage. The CONCERN EWS significantly associated with reduced risk of in-hospital mortality overall (adjusted hazard ratio [HR] = 0.644, 95% CI: 0.532–0.778, p < 0.0001), with consistent effectiveness across most groups. Notably, patients whose primary language was not English experienced a greater reduction of mortality risk compared to patients whose primary language was English (adjusted HR = 0.419, 95% CI: 0.287–0.610, p = 0.0082).

Conclusions

This study presents a case of evaluating equity in AI-CDSS usage and effectiveness, contributing to the limited literature. While findings suggest equitable engagement and effectiveness, ongoing evaluations are needed to understand the observed variability and ensure responsible implementation.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Decision Support Systems, ClinicalHumansFemaleMaleHospital MortalityMiddle AgedAgedArtificial IntelligenceElectronic Health Records

Autor:innen und Institutionen

  • Department of Biomedical Informatics, Columbia University, New York, New York, United States.
  • School of Nursing, Columbia University, New York, New York, United States.
  • School of Nursing, University of Pennsylvania, Philadelphia, Pennsylvania, United States.
  • Children's Hospital of Philadelphia, Philadelphia, Pennsylvania, United States.
  • Center for Patient Safety, Brigham and Women's Hospital, Boston, Massachusetts, United States.
  • Harvard Medical School, Boston, Massachusetts, United States.

ORCID-Profile: Rachel Y Lee

Förderung

  • American Nurses Foundation

Zitieren

APA

Lee, R. Y., Cato, K. D., Dykes, P. C., Lowenthal, G., Jia, H., Daramola, T., & Rossetti, S. C. (2025). Evaluating Equity in Usage and Effectiveness of the CONCERN Early Warning System. Applied Clinical Informatics, 16(04), 838-847. https://doi.org/10.1055/a-2630-4192

Vancouver

Lee RY, Cato KD, Dykes PC, Lowenthal G, Jia H, Daramola T, et al. Evaluating Equity in Usage and Effectiveness of the CONCERN Early Warning System. Applied Clinical Informatics. 2025;16(04):838-847. doi:10.1055/a-2630-4192

BibTeX
@article{Lee2025,
  author = {Lee, Rachel Y and Cato, Kenrick D and Dykes, Patricia C and Lowenthal, Graham and Jia, Haomiao and Daramola, Temiloluwa and Rossetti, Sarah C},
  title = {Evaluating Equity in Usage and Effectiveness of the CONCERN Early Warning System},
  journal = {Applied Clinical Informatics},
  year = {2025},
  volume = {16},
  number = {04},
  pages = {838--847},
  doi = {10.1055/a-2630-4192}
}
Kostenlos starten →