EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Escalation Architecture in AI-Enabled Patient Care: Designing Safety Systems That Work in Practice

David Whitehead, Rishi Khakhkhar, Tony Sun, Cian Owen Hughes, Muthuraman Alagappan, Hashem Zikry

Digital Biomarkers · 14.11.2026

DOI: 10.1159/dib/acpag007 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Digital Biomarkers, online erschienen am 14.11.2026. Verfasst von David Whitehead und 5 weiteren Autor:innen. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Introduction

Demand for medical care continues to outpace the supply of clinicians, and AI agents are already conducting patient encounters at scale. The highest-stakes decision an agent makes is whether to route a patient out of self-care and into acute care. We evaluated a dual-agent escalation architecture, deployed at an AI-native physician in the loop virtual care company, in which a dedicated safety agent runs in parallel with a messaging agent, and we assessed how the home-to-acute-care decision should be designed and governed.

Methods

The safety agent was evaluated in two settings. In silico, it was benchmarked against four leading foundation models on the consensus subset of a public health benchmark, restricted to single-patient, English-language, escalation-relevant scenarios. In practice, the agentic workflow was deployed to 162 patients recruited by online advertisement between July and August 2025, covering 477 clinical encounters. Two board-certified emergency medicine physicians independently reviewed every conversation and labeled whether they would advise emergency evaluation, using a conservative criterion. The same de-identified encounters were scored by a general-purpose foundation model for comparison.

Results

The safety agent flagged 41 of 477 encounters (8.6%) as potential emergencies and achieved 88.0% sensitivity (95% CI 70.0-95.8%) and 95.8% specificity (95% CI 93.5-97.3%) against the physician gold standard, with a positive predictive value of 53.7% and a negative predictive value of 99.3%. The general-purpose model reached 80.0% sensitivity and 44.4% positive predictive value on the same encounters. On the benchmark subset, all models achieved perfect recall, but precision was 0.84 for the safety agent compared with 0.27 to 0.29 for the foundation models. Published results for nurse-led telephone triage and a widely used symptom checker are reported for context only, because those studies used different populations and reference standards.

Conclusion

Escalation is the safety-critical center of agentic patient care, and a dedicated safety agent outperformed both a general-purpose model and published comparators on emergency detection. Digital biomarkers, which already inform decisions in heart failure, diabetes, and bipolar disorder, are the next major class of escalation inputs. Phased deployment tied to concordance and safety benchmarks, with explicit rollback criteria, offers a workable governance model for autonomous clinical AI.

Zitieren

APA

Whitehead, D., Khakhkhar, R., Sun, T., Hughes, C. O., Alagappan, M., & Zikry, H. (2026). Escalation Architecture in AI-Enabled Patient Care: Designing Safety Systems That Work in Practice. Digital Biomarkers. https://doi.org/10.1159/dib/acpag007

Vancouver

Whitehead D, Khakhkhar R, Sun T, Hughes CO, Alagappan M, Zikry H. Escalation Architecture in AI-Enabled Patient Care: Designing Safety Systems That Work in Practice. Digital Biomarkers. 2026. doi:10.1159/dib/acpag007

BibTeX
@article{Whitehead2026,
  author = {Whitehead, David and Khakhkhar, Rishi and Sun, Tony and Hughes, Cian Owen and Alagappan, Muthuraman and Zikry, Hashem},
  title = {Escalation Architecture in AI-Enabled Patient Care: Designing Safety Systems That Work in Practice},
  journal = {Digital Biomarkers},
  year = {2026},
  doi = {10.1159/dib/acpag007}
}
Kostenlos starten →