Prompting Pro Tips! Best Practices for Generating Clinical Narrative Summaries
Military Medicine · 2026
DOI: 10.1093/milmed/usaf247 ↗Kurz gefasst
Fachartikel in der Zeitschrift Military Medicine, 2026. Verfasst von Darshan Thota und 3 weiteren Autor:innen. Beteiligte Einrichtung: Joint Trauma System, San Antonio, TX 78234, United States. Hauptthemen laut MEDLINE: Narration, Medical Records. Die Arbeit wurde bisher 3-mal zitiert (Crossref) und nennt 11 Literaturangaben.
Abstract (Originalsprache)
Introduction
Generating clinical narrative summaries is a critical use case for the Military Health System. This study evaluates the performance of detailed versus vague prompts in generating summaries that yield accurate, bias-free, and meaningful outputs. Materials and Methods Eight anonymized large language models (LLMs) were evaluated by volunteer clinicians for clinical narrative summary generation from October through November of 2024. Eight clinical scenarios were presented to each model with structured and vague prompt variations, and the responses were evaluated for conformance, task adequacy, hallucinations, and bias.
Results
Both approaches were comparable in conforming to instructions (64%). The structured approach was more likely to produce a clinically adequate summary (39% compared to 9%) but also more likely to introduce hallucinations and bias.
Discussion
The structured prompt, following best practices for prompt engineering, produced a superior response but was prone to hallucinations. This could be mitigated with additional tuning. None of the models tested reliably produced clinically usable summaries.
Conclusion
Efficient generation of clinical summaries is critical for the Military Health System. Using a structured prompt that employs role, task, tone, and format increases the output quality. Institutions seeking to use LLMs to summarize clinical notes may have more success with a structured approach but need to be cautious in ensuring the summary itself is true to its source documents.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Autor:innen und Institutionen
- Joint Trauma System, San Antonio, TX 78234, United States.
- Defense Health Agency Health Informatics, Falls Church, VA 22042, United States.
- Uniformed Service University, Bethesda, MD 20814, United States.
- Naval Medical Forces Pacific, San Diego, CA 92136, United States.
ORCID-Profile: Darshan Thota
Zitieren
APA
Thota, D., Alt, D., Cole, J., & Tring, V. S. (2026). Prompting Pro Tips! Best Practices for Generating Clinical Narrative Summaries. Military Medicine. https://doi.org/10.1093/milmed/usaf247
Vancouver
Thota D, Alt D, Cole J, Tring VS. Prompting Pro Tips! Best Practices for Generating Clinical Narrative Summaries. Military Medicine. 2026. doi:10.1093/milmed/usaf247
BibTeX
@article{Thota2026,
author = {Thota, Darshan and Alt, David and Cole, Jacob and Tring, Vi Song},
title = {Prompting Pro Tips! Best Practices for Generating Clinical Narrative Summaries},
journal = {Military Medicine},
year = {2026},
doi = {10.1093/milmed/usaf247}
}
EUVIMED