Uncertainty Quantification and Interpretability for Clinical Trial Approval Prediction
Health Data Science · 2024-01 · 4
DOI: 10.34133/hds.0126 ↗Kurz gefasst
Fachartikel in der Zeitschrift Health Data Science, online erschienen am 15.04.2024. Verfasst von Yingzhou Lu und 5 weiteren Autor:innen. Beteiligte Einrichtung: School of Medicine, Stanford University, Stanford, CA, USA. Die Arbeit wurde bisher 28-mal zitiert (Crossref) und nennt 64 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar.
Abstract (Originalsprache)
Background
Clinical trial is a crucial step in the development of a new therapy (e.g., medication) and is remarkably expensive and time-consuming. Forecasting the approval of clinical trials accurately would enable us to circumvent trials destined to fail, thereby allowing us to allocate more resources to therapies with better chances. However, existing approval prediction algorithms did not quantify the uncertainty and provide interpretability, limiting their usage in real-world clinical trial management.
Methods
This paper quantifies uncertainty and improves interpretability in clinical trial approval predictions. We devised a selective classification approach and integrated it with the Hierarchical Interaction Network, the state-of-the-art clinical trial prediction model. Selective classification, encompassing a spectrum of methods for uncertainty quantification, empowers the model to withhold decision-making in the face of samples marked by ambiguity or low confidence. This approach not only amplifies the accuracy of predictions for the instances it chooses to classify but also notably enhances the model’s interpretability.
Results
Comprehensive experiments demonstrate that incorporating uncertainty markedly enhances the model’s performance. Specifically, the proposed method achieved 32.37%, 21.43%, and 13.27% relative improvement on area under the precision–recall curve over the base model (Hierarchical Interaction Network) in phase I, II, and III trial approval predictions, respectively. For phase III trials, our method reaches 0.9022 area under the precision–recall curve scores. In addition, we show a case study of interpretability that helps domain experts to understand model’s outcome. The code is publicly available at https://github.com/Vincent-1125/Uncertainty-Quantification-on-Clinical-Trial-Outcome-Prediction .
Conclusion
Our approach not only measures model uncertainty but also greatly improves interpretability and performance for clinical trial approval prediction.
Autor:innen und Institutionen
- School of Medicine, Stanford University, Stanford, CA, USA.
- Computer Science Department, Rensselaer Polytechnic Institute, Troy, NY, USA.
- Stony Brook University Hospital, Stony Brook, NY, USA.
- Computer Science Department, University of Illinois Urbana-Champaign, Urbana, IL, USA.
Zitieren
APA
Lu, Y., Chen, T., Hao, N., Van Rechem, C., Chen, J., & Fu, T. (2024). Uncertainty Quantification and Interpretability for Clinical Trial Approval Prediction. Health Data Science, 4. https://doi.org/10.34133/hds.0126
Vancouver
Lu Y, Chen T, Hao N, Van Rechem C, Chen J, Fu T. Uncertainty Quantification and Interpretability for Clinical Trial Approval Prediction. Health Data Science. 2024;4. doi:10.34133/hds.0126
BibTeX
@article{Lu2024,
author = {Lu, Yingzhou and Chen, Tianyi and Hao, Nan and Van Rechem, Capucine and Chen, Jintai and Fu, Tianfan},
title = {Uncertainty Quantification and Interpretability for Clinical Trial Approval Prediction},
journal = {Health Data Science},
year = {2024},
volume = {4},
doi = {10.34133/hds.0126}
}
EUVIMED