Extracting structured information from unstructured histopathology reports using generative pre‐trained transformer 4 ( GPT ‐4)
The Journal of Pathology · 2024-03 · 262 (3) · 310-319
DOI: 10.1002/path.6232 ↗At a glance
Journal article in The Journal of Pathology, published online on 2023-12-14. Written by Daniel Truhn and 8 co-authors. Institution: Department of Diagnostic and Interventional Radiology, University Hospital RWTH Aachen, Aachen, Germany. Major MEDLINE topics: Precision Medicine, Glioblastoma. Cited 132 times so far (Crossref); 19 references. The full text is freely available (open access, CC BY 4.0). Funded by: German Federal Ministry of Health, Max-Eder-Programme of the German Cancer Aid, German Federal Ministry of Education and Research.
Abstract (original language)
Deep learning applied to whole‐slide histopathology images (WSIs) has the potential to enhance precision oncology and alleviate the workload of experts. However, developing these models necessitates large amounts of data with ground truth labels, which can be both time‐consuming and expensive to obtain. Pathology reports are typically unstructured or poorly structured texts, and efforts to implement structured reporting templates have been unsuccessful, as these efforts lead to perceived extra workload. In this study, we hypothesised that large language models (LLMs), such as the generative pre‐trained transformer 4 (GPT‐4), can extract structured data from unstructured plain language reports using a zero‐shot approach without requiring any re‐training. We tested this hypothesis by utilising GPT‐4 to extract information from histopathological reports, focusing on two extensive sets of pathology reports for colorectal cancer and glioblastoma. We found a high concordance between LLM‐generated structured data and human‐generated structured data. Consequently, LLMs could potentially be employed routinely to extract ground truth data for machine learning from unstructured pathology reports in the future. © 2023 The Authors. The Journal of Pathology published by John Wiley & Sons Ltd on behalf of The Pathological Society of Great Britain and Ireland.
Subjects
MeSH terms (MEDLINE)
Author keywords
Authors and institutions
- Department of Diagnostic and Interventional Radiology, University Hospital RWTH Aachen, Aachen, Germany.
- Else Kroener Fresenius Center for Digital Health, Technical University Dresden, Dresden, Germany.
- Department of Medicine I, University Hospital Dresden, Dresden, Germany.
- Department of Medicine III, University Hospital RWTH Aachen, Aachen, Germany.
- Department of Neurosurgery, University Hospital Erlangen, Erlangen, Germany.
- Department of Radiology, Charité - Universitätsmedizin Berlin, corporate member of Freie Universität Berlin and Humboldt-Universität zu Berlin, Berlin, Germany.
ORCID profiles: Jakob Nikolas Kather
Funding
- German Federal Ministry of Health
- Max-Eder-Programme of the German Cancer Aid
- German Federal Ministry of Education and Research
- German Academic Exchange Service
- German Federal Joint Committee
- European Union's Horizon Europe and Innovation Programme
- National Institute for Health and Care Research
- Leeds Biomedical Research Centre
Cite
APA
Truhn, D., Loeffler, C. M., Müller-Franzes, G., Nebelung, S., Hewitt, K. J., Brandner, S., Bressem, K. K., Foersch, S., & Kather, J. N. (2024). Extracting structured information from unstructured histopathology reports using generative pre‐trained transformer 4 ( GPT ‐4). The Journal of Pathology, 262(3), 310-319. https://doi.org/10.1002/path.6232
Vancouver
Truhn D, Loeffler CM, Müller-Franzes G, Nebelung S, Hewitt KJ, Brandner S, et al. Extracting structured information from unstructured histopathology reports using generative pre‐trained transformer 4 ( GPT ‐4). The Journal of Pathology. 2024;262(3):310-319. doi:10.1002/path.6232
BibTeX
@article{Truhn2024,
author = {Truhn, Daniel and Loeffler, Chiara Ml and Müller-Franzes, Gustav and Nebelung, Sven and Hewitt, Katherine J and Brandner, Sebastian and Bressem, Keno K and Foersch, Sebastian and Kather, Jakob Nikolas},
title = {Extracting structured information from unstructured histopathology reports using generative pre‐trained transformer 4 ( GPT ‐4)},
journal = {The Journal of Pathology},
year = {2024},
volume = {262},
number = {3},
pages = {310--319},
doi = {10.1002/path.6232}
}
EUVIMED