Classifying Clinical Evidence Levels of Cancer Variants in Biomedical Literature Using Machine Learning and Large Language Models
Studies in Health Technology and Informatics · 21.05.2026
DOI: 10.3233/shti260300 ↗Kurz gefasst
Fachartikel in der Zeitschrift Studies in Health Technology and Informatics, erschienen am 21.05.2026. Verfasst von Graziella Credidio und 4 weiteren Autor:innen. Beteiligte Einrichtung: University Medical Center Hamburg-Eppendorf (UKE), Institute for Applied Medical Informatics, Hamburg, Germany. Hauptthemen laut MEDLINE: Large Language Models, Machine Learning, Neoplasms, Natural Language Processing. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0).
Abstract (Originalsprache)
Automating the classification of clinical evidence levels in biomedical literature can support precision oncology by facilitating the acceleration of variant interpretation and informed decision-making. This study compares the performance of two state-of-the-art large language models (LLMs) (GPT-4.1-mini and Gemini-2.5-Flash) and two machine learning (ML) algorithms (decision tree and XGBoost) for classifying publications according to the Clinical Interpretation of Variants in Cancer (CIViC) evidence level system. Zero- and few-shot prompting strategies were tested for LLMs, while Term Frequency-Inverse Document Frequency (TF-IDF) and word embedding representations were evaluated for ML models. XGBoost with TF-IDF achieved the highest performance (micro-F1 = 0.83), outperforming both LLMs and decision trees. All models performed best on mid-range evidence levels (B to D) and struggled with high (A) and inferential (E) levels, reflecting dataset imbalance and linguistic ambiguity. These findings suggest that, at present, abstract-level evidence classification is largely driven by explicit lexical cues, with limited added benefit from standalone LLM-based approaches.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- University Medical Center Hamburg-Eppendorf (UKE), Institute for Applied Medical Informatics, Hamburg, Germany.
- Secondary Use of Data in Oncology Group, Clinical Trial Office, DKFZ, Heidelberg, Germany.
Zitieren
APA
Credidio, G., Größler, M., Roth, B., Knurr, A., & Riemann, L. T. (2026). Classifying Clinical Evidence Levels of Cancer Variants in Biomedical Literature Using Machine Learning and Large Language Models. Studies in Health Technology and Informatics. https://doi.org/10.3233/shti260300
Vancouver
Credidio G, Größler M, Roth B, Knurr A, Riemann LT. Classifying Clinical Evidence Levels of Cancer Variants in Biomedical Literature Using Machine Learning and Large Language Models. Studies in Health Technology and Informatics. 2026. doi:10.3233/shti260300
BibTeX
@article{Credidio2026,
author = {Credidio, Graziella and Größler, Michael and Roth, Benjamin and Knurr, Alexander and Riemann, Layla Tabea},
title = {Classifying Clinical Evidence Levels of Cancer Variants in Biomedical Literature Using Machine Learning and Large Language Models},
journal = {Studies in Health Technology and Informatics},
year = {2026},
doi = {10.3233/shti260300}
}
EUVIMED