EUVIMEDEUVIMED entdecken
FallberichtOpen Access · CC BY-NC 4.0

Automated Extraction of Genetic Eligibility Criteria from Clinical Trial Records Using LLMs – A Technical Case Report

Georg Mathes, Stephanie Berger, Stefan Sigle

Studies in Health Technology and Informatics · 2026

DOI: 10.3233/shti260998 ↗

Kurz gefasst

Fallbericht in der Zeitschrift Studies in Health Technology and Informatics, 2026. Verfasst von Georg Mathes und 2 weiteren Autor:innen. Beteiligte Einrichtung: MOLIT Institute gGmbH, Heilbronn, Germany. Hauptthemen laut MEDLINE: Large Language Models, Clinical Trials as Topic, Data Mining, Natural Language Processing. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Introduction

Accurate interpretation of clinical trial eligibility criteria is essential for applications such as patient-trial matching and clinical decision support, particularly in precision oncology. However, relevant information, including genetic mutation requirements, is typically embedded in unstructured text within trial registries such as ClinicalTrials.gov, limiting accessibility for automated processing.

Methods

This paper reports on development, integration and evaluation of a system for extracting and structuring mutational eligibility criteria from trial records, focusing on identifying mutated genes, distinguishing inclusion and exclusion criteria, and assigning them to individual study arms. To address challenges like ambiguous abbreviations and context-dependent meaning, we combine large language models (LLMs) for context-aware extraction with rule-based validation against HUGO Gene Nomenclature. The system was implemented using local LLMs and integrated into the Community Annotated Trial Search (CATS) platform.

Results

Applied to 4,918 clinical trials, the system generated structured representations of genetic eligibility criteria for 1,010 studies. Expert review of 42 trials showed that 88.1% of studies were correctly annotated, with a precision of 80% at the level of individual eligibility criteria. Failures were mainly due to hallucinated genes and misinterpreted abbreviations, highlighting challenges in biomedical text processing.

Discussion

The findings indicate that LLM-based extraction is a promising approach for structuring complex eligibility criteria, particularly when combined with strategies to improve precision. The integration into an operational system demonstrates practical feasibility, while the observed limitations emphasize the need for careful dataset design, error mitigation strategies, and continued refinement to achieve reliable automation in clinical applications.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Large Language ModelsClinical Trials as TopicData MiningNatural Language ProcessingEligibility DeterminationElectronic Health RecordsHumansMutation

Stichwörter der Autor:innen

Clinical TrialData MiningGenesHealth Information InteroperabilityPrecision OncologyTerminology

Autor:innen und Institutionen

  • MOLIT Institute gGmbH, Heilbronn, Germany.
  • SLK Clinics, Heilbronn, Germany.

Zitieren

APA

Mathes, G., Berger, S., & Sigle, S. (2026). Automated Extraction of Genetic Eligibility Criteria from Clinical Trial Records Using LLMs – A Technical Case Report. Studies in Health Technology and Informatics. https://doi.org/10.3233/shti260998

Vancouver

Mathes G, Berger S, Sigle S. Automated Extraction of Genetic Eligibility Criteria from Clinical Trial Records Using LLMs – A Technical Case Report. Studies in Health Technology and Informatics. 2026. doi:10.3233/shti260998

BibTeX
@article{Mathes2026,
  author = {Mathes, Georg and Berger, Stephanie and Sigle, Stefan},
  title = {Automated Extraction of Genetic Eligibility Criteria from Clinical Trial Records Using LLMs – A Technical Case Report},
  journal = {Studies in Health Technology and Informatics},
  year = {2026},
  doi = {10.3233/shti260998}
}
Kostenlos starten →