A Comparative Study of Generative Artificial Intelligence Versus Clinical Experts for Evidence-Based Decision-Making in Austere Environments
Military Medicine · 07.07.2026
DOI: 10.1093/milmed/usag312 ↗Kurz gefasst
Fachartikel in der Zeitschrift Military Medicine, online erschienen am 07.07.2026. Verfasst von Ross M Scallan und 5 weiteren Autor:innen. Beteiligte Einrichtung: Center for Nursing Science and Clinical Inquiry, Landstuhl Regional Medical Center, Landstuhl, Rheinland-Pfalz 66849, Germany. Die Arbeit nennt 39 Literaturangaben.
Abstract (Originalsprache)
Introduction
The exponential growth of biomedical data hinders the rapid adoption of evidence-based practices in the Military Health System. This is critical in austere environments where teams rely on limited resources. Generative artificial intelligence (AI) offers a potential solution for rapidly synthesizing evidence. This comparative study evaluated the utility and feasibility of generative AI tools compared to human clinical experts in identifying protocols for surgical instrument reprocessing in austere settings. Materials and Methods We conducted a descriptive comparative study to query four AI platforms (NIPRGPT, ChatGPT, Google Gemini, GenAI.mil) and two clinical experts. The authors prompted each group to identify a single best recommendation for reprocessing surgical instruments in austere environments without steam sterilization capabilities. We compared the outputs based on time-to-completion, accessibility behind Department of War (DoW) firewalls, and clinical validity against a literature review.
Results
AI platforms generated recommendations in under 10 minutes. Clinical experts required 14 hours to review and synthesize data. Regarding accessibility, commercial platforms (ChatGPT, Gemini) were blocked by DoD firewalls, while GenAI.mil was accessible. Clinical experts recommended chlorine dioxide (ClO2) due to its sporicidal properties, which ensure sterility assurance. Only ChatGPT matched this recommendation. Conversely, GenAI.mil and Gemini recommended ortho-phthalaldehyde (OPA), and NIPRGPT recommended glutaraldehyde. The AI models prioritized processing speed over sterility assurance.
Conclusions
Generative AI significantly reduces the cognitive load and time required to synthesize clinical protocols. However, government-hosted AI tools prioritized logistical factors over safety standards in this study. We identified an accessibility-accuracy paradox where the most accessible tool provided less rigorous safety recommendations. Implementation requires human verification and specific governance to ensure AI supports rather than replaces clinical judgment.
Autor:innen und Institutionen
- Center for Nursing Science and Clinical Inquiry, Landstuhl Regional Medical Center, Landstuhl, Rheinland-Pfalz 66849, Germany.
- Center for Nursing Science and Clinical Inquiry, Madigan Army Medical Center, Joint Base Lewis-McChord, Tacoma, WA 98433, United States.
- Department of Nursing, Brian D. Allgood Army Community Hospital, Pyeongtaek 17977, South Korea.
ORCID-Profile: Ross M Scallan, Bethany Atwood, Chandler H Moser, Gina L Eberhardt, Christopher Stucky, Stephanie Kessinger
Zitieren
APA
Scallan, R. M., Atwood, B., Moser, C. H., Eberhardt, G. L., Stucky, C., & Kessinger, S. (2026). A Comparative Study of Generative Artificial Intelligence Versus Clinical Experts for Evidence-Based Decision-Making in Austere Environments. Military Medicine. https://doi.org/10.1093/milmed/usag312
Vancouver
Scallan RM, Atwood B, Moser CH, Eberhardt GL, Stucky C, Kessinger S. A Comparative Study of Generative Artificial Intelligence Versus Clinical Experts for Evidence-Based Decision-Making in Austere Environments. Military Medicine. 2026. doi:10.1093/milmed/usag312
BibTeX
@article{Scallan2026,
author = {Scallan, Ross M and Atwood, Bethany and Moser, Chandler H and Eberhardt, Gina L and Stucky, Christopher and Kessinger, Stephanie},
title = {A Comparative Study of Generative Artificial Intelligence Versus Clinical Experts for Evidence-Based Decision-Making in Austere Environments},
journal = {Military Medicine},
year = {2026},
doi = {10.1093/milmed/usag312}
}
EUVIMED