A local outpatient practice-level prediction model for short-term psychiatric emergency presentation
JAMIA Open · 09.09.2026 · 9 (5)
DOI: 10.1093/jamiaopen/ooag215 ↗Kurz gefasst
Fachartikel in der Zeitschrift JAMIA Open, online erschienen am 02.11.2026. Verfasst von John L Havlik und 4 weiteren Autor:innen. Beteiligte Einrichtung: Department of Psychiatry and Behavioral Sciences, Stanford University School of Medicine, Palo Alto, CA 94304, United States. Die Arbeit nennt 30 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Objectives
To determine whether statewide health information exchange (HIE) data can support practice-level prediction of short-term psychiatric emergency presentation, and to compare a locally trained model with general-purpose clinical risk scores. Materials and Methods Retrospective cohort of patients at 1 Montana psychiatry practice with records in the Big Sky Care Connect statewide HIE. Structured HIE data were linked to zip code-level Social Vulnerability Index and Area Deprivation Index measures. Each observation was a patient snapshot. Logistic regression, random forest, and LightGBM models were tuned with 5 × 5 nested cross-validation and evaluated on a temporally held-out test set. The primary outcome was psychiatric or substance-related emergency department (ED) presentation within 30 days. Discrimination was compared with a parsimonious clinical baseline and the LACE and Elixhauser indices.
Results
The test set contained 16 469 snapshots, of which 343 (2.1%) preceded a qualifying ED presentation (102 visits among 68 patients). A random forest model achieved area under the receiver-operator characteristic curve 0.85 (95% CI, 0.75-0.91). At a threshold targeting one-third recall, precision was 0.29 (0.12-0.44) and number needed to evaluate 3.4 (2.3-8.1). Discrimination exceeded the clinical baseline (Δ area under the curve 0.10), LACE (0.19), and Elixhauser (0.27); all P values less than .001.
Discussion
Structured HIE data, without clinical notes, supported a practice-specific model that outperformed general-purpose scores such as LACE and Elixhauser. Wide CIs reflect a small event count and constrain point-estimate claims. Conclusion health information exchange infrastructure may allow participating practices to build locally calibrated psychiatric risk models. Prospective study of clinical utility is needed.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Psychiatry and Behavioral Sciences, Stanford University School of Medicine, Palo Alto, CA 94304, United States.
- Big Sky Care Connect, Missoula, MT 59802, United States.
- Frontier Psychiatry, Billings, MT 59102, United States.
- Yale Child Study Center, Yale University School of Medicine, New Haven, CT 06519, United States.
Zitieren
APA
Havlik, J. L., Tyrrell, B., Polaschek, J., Bell, N., & Arzubi, E. R. (2026). A local outpatient practice-level prediction model for short-term psychiatric emergency presentation. JAMIA Open, 9(5). https://doi.org/10.1093/jamiaopen/ooag215
Vancouver
Havlik JL, Tyrrell B, Polaschek J, Bell N, Arzubi ER. A local outpatient practice-level prediction model for short-term psychiatric emergency presentation. JAMIA Open. 2026;9(5). doi:10.1093/jamiaopen/ooag215
BibTeX
@article{Havlik2026,
author = {Havlik, John L and Tyrrell, Ben and Polaschek, Jeanette and Bell, Nathan and Arzubi, Eric R},
title = {A local outpatient practice-level prediction model for short-term psychiatric emergency presentation},
journal = {JAMIA Open},
year = {2026},
volume = {9},
number = {5},
doi = {10.1093/jamiaopen/ooag215}
}
EUVIMED