EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC 4.0

Classifying Clinical Evidence Levels of Cancer Variants in Biomedical Literature Using Machine Learning and Large Language Models

Graziella Credidio, Michael Größler, Benjamin Roth, Alexander Knurr, Layla Tabea Riemann

Studies in Health Technology and Informatics · 21.05.2026

DOI: 10.3233/shti260300 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Studies in Health Technology and Informatics, erschienen am 21.05.2026. Verfasst von Graziella Credidio und 4 weiteren Autor:innen. Beteiligte Einrichtung: University Medical Center Hamburg-Eppendorf (UKE), Institute for Applied Medical Informatics, Hamburg, Germany. Hauptthemen laut MEDLINE: Large Language Models, Machine Learning, Neoplasms, Natural Language Processing. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Automating the classification of clinical evidence levels in biomedical literature can support precision oncology by facilitating the acceleration of variant interpretation and informed decision-making. This study compares the performance of two state-of-the-art large language models (LLMs) (GPT-4.1-mini and Gemini-2.5-Flash) and two machine learning (ML) algorithms (decision tree and XGBoost) for classifying publications according to the Clinical Interpretation of Variants in Cancer (CIViC) evidence level system. Zero- and few-shot prompting strategies were tested for LLMs, while Term Frequency-Inverse Document Frequency (TF-IDF) and word embedding representations were evaluated for ML models. XGBoost with TF-IDF achieved the highest performance (micro-F1 = 0.83), outperforming both LLMs and decision trees. All models performed best on mid-range evidence levels (B to D) and struggled with high (A) and inferential (E) levels, reflecting dataset imbalance and linguistic ambiguity. These findings suggest that, at present, abstract-level evidence classification is largely driven by explicit lexical cues, with limited added benefit from standalone LLM-based approaches.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Large Language ModelsMachine LearningNeoplasmsNatural Language ProcessingHumansBoosting Machine Learning AlgorithmsClassification AlgorithmsPredictive Learning Models

Stichwörter der Autor:innen

Clinical Evidence LevelLarge Language ModelsMachine LearningText Classification

Autor:innen und Institutionen

  • University Medical Center Hamburg-Eppendorf (UKE), Institute for Applied Medical Informatics, Hamburg, Germany.
  • Secondary Use of Data in Oncology Group, Clinical Trial Office, DKFZ, Heidelberg, Germany.

Zitieren

APA

Credidio, G., Größler, M., Roth, B., Knurr, A., & Riemann, L. T. (2026). Classifying Clinical Evidence Levels of Cancer Variants in Biomedical Literature Using Machine Learning and Large Language Models. Studies in Health Technology and Informatics. https://doi.org/10.3233/shti260300

Vancouver

Credidio G, Größler M, Roth B, Knurr A, Riemann LT. Classifying Clinical Evidence Levels of Cancer Variants in Biomedical Literature Using Machine Learning and Large Language Models. Studies in Health Technology and Informatics. 2026. doi:10.3233/shti260300

BibTeX
@article{Credidio2026,
  author = {Credidio, Graziella and Größler, Michael and Roth, Benjamin and Knurr, Alexander and Riemann, Layla Tabea},
  title = {Classifying Clinical Evidence Levels of Cancer Variants in Biomedical Literature Using Machine Learning and Large Language Models},
  journal = {Studies in Health Technology and Informatics},
  year = {2026},
  doi = {10.3233/shti260300}
}
Kostenlos starten →