EUVIMEDEUVIMED entdecken
Open Access

Uncertainty Quantification and Interpretability for Clinical Trial Approval Prediction

Yingzhou Lu, Tianyi Chen, Nan Hao, Capucine Van Rechem, Jintai Chen, Tianfan Fu

Health Data Science · 2024-01 · 4

DOI: 10.34133/hds.0126 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Health Data Science, online erschienen am 15.04.2024. Verfasst von Yingzhou Lu und 5 weiteren Autor:innen. Beteiligte Einrichtung: School of Medicine, Stanford University, Stanford, CA, USA. Die Arbeit wurde bisher 28-mal zitiert (Crossref) und nennt 64 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background

Clinical trial is a crucial step in the development of a new therapy (e.g., medication) and is remarkably expensive and time-consuming. Forecasting the approval of clinical trials accurately would enable us to circumvent trials destined to fail, thereby allowing us to allocate more resources to therapies with better chances. However, existing approval prediction algorithms did not quantify the uncertainty and provide interpretability, limiting their usage in real-world clinical trial management.

Methods

This paper quantifies uncertainty and improves interpretability in clinical trial approval predictions. We devised a selective classification approach and integrated it with the Hierarchical Interaction Network, the state-of-the-art clinical trial prediction model. Selective classification, encompassing a spectrum of methods for uncertainty quantification, empowers the model to withhold decision-making in the face of samples marked by ambiguity or low confidence. This approach not only amplifies the accuracy of predictions for the instances it chooses to classify but also notably enhances the model’s interpretability.

Results

Comprehensive experiments demonstrate that incorporating uncertainty markedly enhances the model’s performance. Specifically, the proposed method achieved 32.37%, 21.43%, and 13.27% relative improvement on area under the precision–recall curve over the base model (Hierarchical Interaction Network) in phase I, II, and III trial approval predictions, respectively. For phase III trials, our method reaches 0.9022 area under the precision–recall curve scores. In addition, we show a case study of interpretability that helps domain experts to understand model’s outcome. The code is publicly available at https://github.com/Vincent-1125/Uncertainty-Quantification-on-Clinical-Trial-Outcome-Prediction .

Conclusion

Our approach not only measures model uncertainty but also greatly improves interpretability and performance for clinical trial approval prediction.

Autor:innen und Institutionen

  • School of Medicine, Stanford University, Stanford, CA, USA.
  • Computer Science Department, Rensselaer Polytechnic Institute, Troy, NY, USA.
  • Stony Brook University Hospital, Stony Brook, NY, USA.
  • Computer Science Department, University of Illinois Urbana-Champaign, Urbana, IL, USA.

Zitieren

APA

Lu, Y., Chen, T., Hao, N., Van Rechem, C., Chen, J., & Fu, T. (2024). Uncertainty Quantification and Interpretability for Clinical Trial Approval Prediction. Health Data Science, 4. https://doi.org/10.34133/hds.0126

Vancouver

Lu Y, Chen T, Hao N, Van Rechem C, Chen J, Fu T. Uncertainty Quantification and Interpretability for Clinical Trial Approval Prediction. Health Data Science. 2024;4. doi:10.34133/hds.0126

BibTeX
@article{Lu2024,
  author = {Lu, Yingzhou and Chen, Tianyi and Hao, Nan and Van Rechem, Capucine and Chen, Jintai and Fu, Tianfan},
  title = {Uncertainty Quantification and Interpretability for Clinical Trial Approval Prediction},
  journal = {Health Data Science},
  year = {2024},
  volume = {4},
  doi = {10.34133/hds.0126}
}
Kostenlos starten →