ct-validation: an open framework for benchmarking target-indication evidence against clinical trial outcomes
Bioinformatics · 02.10.2026 · 42 (10)
DOI: 10.1093/bioinformatics/btag788 ↗Kurz gefasst
Fachartikel in der Zeitschrift Bioinformatics, online erschienen am 20.10.2026. Verfasst von Klim Kostiuk und 3 weiteren Autor:innen. Beteiligte Einrichtung: Translational AI and Discovery, GERO PTE. LTD., 133 Cecil Street 14-01 Keck Seng Tower, 069535, Singapore. Hauptthemen laut MEDLINE: Benchmarking, Clinical Trials as Topic, Software, Computational Biology. Die Arbeit nennt 17 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: GERO PTE. LTD.
Abstract (Originalsprache)
Summary Human genetic evidence provides a strong foundation for selecting drug targets. However, consistent benchmarking of target-indication evidence against clinical trial outcomes has been hindered by proprietary data and customized pipelines. To address this, we present the Python package ct-validation, which evaluates whether target-indication pairs supported by specific evidence sources are enriched for clinical progression. This package computes relative success (RS) and odds ratios with confidence intervals across clinical phase transitions. It also supports ontology-based semantic disease matching and offers interfaces in Python, on the command line, and via the Model Context Protocol. By remapping the benchmark from Minikel et al. (2024) to the Experimental Factor Ontology, we reproduced their per-transition enrichment, with a maximum difference of only 1.4% across any transition. In a systematic 3 × 3 benchmark that independently varies the genetic evidence and clinical trial sources, we found that a single curated open clinical trial source reproduces the signal of the proprietary comparator (RS = 2.92 versus 2.65; 2.34 versus 2.55 without oncology). However, aggregating open clinical trial registries compresses this signal (RS = 1.52); this loss is primarily driven by the breadth of the indication data rather than the genetic evidence. Availability and implementation ct-validation is implemented in Python (version 3.11 or higher), distributed via pip, and freely available at https://github.com/gero-science/ct-validation, with support for Python, command-line, and Model Context Protocol interfaces. Archived code: https://doi.org/10.5281/zenodo.22901497. Benchmark data: https://doi.org/10.5281/zenodo.22901451
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Autor:innen und Institutionen
- Translational AI and Discovery, GERO PTE. LTD., 133 Cecil Street 14-01 Keck Seng Tower, 069535, Singapore.
Förderung
- GERO PTE. LTD
Zitieren
APA
Kostiuk, K., Igumnov, D., Fedichev, P., & Feizi, A. (2026). ct-validation: an open framework for benchmarking target-indication evidence against clinical trial outcomes. Bioinformatics, 42(10). https://doi.org/10.1093/bioinformatics/btag788
Vancouver
Kostiuk K, Igumnov D, Fedichev P, Feizi A. ct-validation: an open framework for benchmarking target-indication evidence against clinical trial outcomes. Bioinformatics. 2026;42(10). doi:10.1093/bioinformatics/btag788
BibTeX
@article{Kostiuk2026,
author = {Kostiuk, Klim and Igumnov, Daniel and Fedichev, Peter and Feizi, Amir},
title = {ct-validation: an open framework for benchmarking target-indication evidence against clinical trial outcomes},
journal = {Bioinformatics},
year = {2026},
volume = {42},
number = {10},
doi = {10.1093/bioinformatics/btag788}
}
EUVIMED