Improved Readability and Translational Instability in LLM-Generated Radiology Reports
Academic Radiology · 2026-08
DOI: 10.1016/j.acra.2026.07.040 ↗Kurz gefasst
Fachartikel in der Zeitschrift Academic Radiology, 2026-08. Verfasst von Yunhai Mao und 3 weiteren Autor:innen. Beteiligte Einrichtung: Department of Radiology, China-Japan Union Hospital of Jilin University, Changchun 130000, China. Die Arbeit nennt 21 Literaturangaben. Gefördert von: Jilin Province Health Commission.
Abstract (Originalsprache)
BACKGROUND: Large language models (LLMs) show promise for converting complex radiology reports into patient-centric language, but inherent output instability may limit clinical application. OBJECTIVES: To quantitatively assess the translational accuracy, error rates, and instability of various LLMs when generating patient-centric radiology reports, and evaluate demographic influences on report readability. MATERIALS AND METHODS: This retrospective study evaluated 320 de-identified radiology reports processed by three LLMs using a two-stage (baseline and optimized) prompt engineering strategy. Two senior radiologists evaluated medical accuracy, completeness, and recommendation suitability. Readability was evaluated by 16 non-medical participants stratified by age and education. RESULTS: Professional radiological evaluation revealed that all tested models exhibited inherent instability, omitted information, and tended to generate risk-averse, generalized clinical recommendations. To address these limitations, optimized structured prompts significantly reduced model output variance and improved translational accuracy, with particularly prominent effects observed in DeepSeek-R1 and ChatGPT-4.0. Overall, large language models significantly enhanced the readability of radiology reports (P < 0.05), with DeepSeek-R1 achieving the best performance. However, patients' self-reported comprehension of the reports was affected by demographic characteristics. CONCLUSION: Large language models can effectively improve the readability of radiology reports, yet all such models inherently suffer from output instability and information omission. Optimized structured prompting can substantially reduce the variability of model outputs and improve the accuracy of medical text translation. Nevertheless, LLMs should currently be strictly confined to human-supervised auxiliary tools rather than applied as standalone clinical solutions.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Radiology, China-Japan Union Hospital of Jilin University, Changchun 130000, China.
- Department of Radiology, China-Japan Union Hospital of Jilin University, Changchun 130000, China. Electronic address: zhangmengchao@jlu.edu.cn.
Förderung
- Jilin Province Health Commission
Zitieren
APA
Mao, Y., Wang, C., Wang, W., & Zhang, M. (2026). Improved Readability and Translational Instability in LLM-Generated Radiology Reports. Academic Radiology. https://doi.org/10.1016/j.acra.2026.07.040
Vancouver
Mao Y, Wang C, Wang W, Zhang M. Improved Readability and Translational Instability in LLM-Generated Radiology Reports. Academic Radiology. 2026. doi:10.1016/j.acra.2026.07.040
BibTeX
@article{Mao2026,
author = {Mao, Yunhai and Wang, Chunyan and Wang, Wei and Zhang, Mengchao},
title = {Improved Readability and Translational Instability in LLM-Generated Radiology Reports},
journal = {Academic Radiology},
year = {2026},
doi = {10.1016/j.acra.2026.07.040}
}
EUVIMED