Structured Transformation of Unstructured Prostate MRI Reports Using Large Language Models
Tomography · 17.06.2025 · 11 (6) · 69
DOI: 10.3390/tomography11060069 ↗Kurz gefasst
Fachartikel in der Zeitschrift Tomography, online erschienen am 17.06.2025. Verfasst von Luca Di Palma und 3 weiteren Autor:innen. Beteiligte Einrichtung: CDI Centro Diagnostico Italiano, Saint Bon 20, 20147 Milan, Italy. Hauptthemen laut MEDLINE: Magnetic Resonance Imaging, Prostatic Neoplasms, Prostate, Natural Language Processing. Die Arbeit wurde bisher 11-mal zitiert (Crossref) und nennt 27 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Objectives: to assess the ability of high-performing open-weight large language models (LLMs) in extracting key radiological features from prostate MRI reports.
Methods
Five LLMs (Llama3.3, DeepSeek-R1-Llama3.3, Phi4, Gemma-2, and Qwen2.5-14B) were used to analyze free-text MRI reports retrieved from clinical practice. Each LLM processed reports three times using specialized prompts to extract (1) dimensions, (2) volume and PSA density, and (3) lesion characteristics. An experienced radiologist manually annotated the dataset, defining entities (Exam) and sub-entities (Lesion, Dimension). Feature- and physician-level performance were then assessed.
Results
250 MRI exams reported by 7 radiologists were analyzed by the LLMs. Feature-level performances showed that DeepSeek-R1-Llama3.3 exhibited the highest average score (98.6% ± 2.1%), followed by Phi4 (98.1% ± 2.2%), Llama3.3 (98.0% ± 3.0%), Qwen2.5 (97.5% ± 3.9%), and Gemma2 (96.0% ± 3.4%). All models excelled in extracting PSA density (100%) and volume (≥98.4%), while lesions’ extraction showed greater variability (88.4–94.0%). LLMs’ performance varied among radiologists: Physician B’s reports yielded the highest mean score (99.9% ± 0.2%), while Physician C’s resulted in the lowest (94.4% ± 2.3%).
Conclusions
LLMs showed promising results in automated feature-extraction from radiology reports, with DeepSeek-R1-Llama3.3 achieving the highest overall score. These models can improve clinical workflows by structuring unstructured medical text. However, a preliminary analysis of reporting styles is necessary to identify potential challenges and optimize prompt design to better align with individual physician reporting styles. This approach can further enhance the robustness and adaptability of LLM-driven clinical data extraction.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- CDI Centro Diagnostico Italiano, Saint Bon 20, 20147 Milan, Italy.
ORCID-Profile: Luca Di Palma
Zitieren
APA
Di Palma, L., Darvizeh, F., Alì, M., & Fazzini, D. (2025). Structured Transformation of Unstructured Prostate MRI Reports Using Large Language Models. Tomography, 11(6), 69. https://doi.org/10.3390/tomography11060069
Vancouver
Di Palma L, Darvizeh F, Alì M, Fazzini D. Structured Transformation of Unstructured Prostate MRI Reports Using Large Language Models. Tomography. 2025;11(6):69. doi:10.3390/tomography11060069
BibTeX
@article{DiPalma2025,
author = {Di Palma, Luca and Darvizeh, Fatemeh and Alì, Marco and Fazzini, Deborah},
title = {Structured Transformation of Unstructured Prostate MRI Reports Using Large Language Models},
journal = {Tomography},
year = {2025},
volume = {11},
number = {6},
pages = {69},
doi = {10.3390/tomography11060069}
}
EUVIMED