EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Reliability-enhanced data cleaning in biomedical machine learning using inductive conformal prediction

Xianghao Zhan iD, Qinmei Xu, Yuanning Zheng, Guangming Lu, Olivier Gevaert iD

PLOS Computational Biology · 2025

DOI: 10.1371/journal.pcbi.1012803 ↗

Kurz gefasst

Fachartikel in der Zeitschrift PLOS Computational Biology, 2025. Verfasst von Xianghao Zhan und 4 weiteren Autor:innen. Beteiligte Einrichtung: Department of Bioengineering, Stanford University, Stanford, California, United States of America. Hauptthemen laut MEDLINE: Machine Learning. Die Arbeit wurde bisher 9-mal zitiert (Crossref) und nennt 46 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: NCI NIH HHS.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Accurately labeling large datasets is important for biomedical machine learning yet challenging while modern data augmentation methods may generate noise in the training data, which may deteriorate machine learning model performance. Existing approaches addressing noisy training data typically rely on strict modeling assumptions, classification models and well-curated dataset. To address these, we propose a novel reliability-based training-data-cleaning method employing inductive conformal prediction (ICP). This method uses a small set of well-curated training data and leverages ICP-calculated reliability metrics to selectively correct mislabeled data and outliers within vast quantities of noisy training data. The efficacy is validated across three classification tasks with distinct modalities: filtering drug-induced-liver-injury (DILI) literature with free-text title and abstract, predicting ICU admission of COVID-19 patients through CT radiomics and electronic health records, and subtyping breast cancer using RNA-sequencing data. Varying levels of noise to the training labels were introduced via label permutation. Our training-data-cleaning method significantly enhanced the downstream classification performance (paired t-tests, p ≤ 0 . 05 among 30 random train/test partitions): significant accuracy enhancement in 86 out of 96 DILI experiments (up to 11.4% increase from 0.812 to 0.905), significant AUROC and AUPRC enhancements in all 48 COVID-19 experiments (up to 23.8% increase from 0.597 to 0.739 for AUROC, and 69.8% increase from 0.183 to 0.311 for AUPRC), and significant accuracy and macro-average F1-score improvements in 47 out of 48 RNA-sequencing experiments (up to 74.6% increase from 0.351 to 0.613 for accuracy, and 89.0% increase from 0.267 to 0.505 for F1-score). The improvement can be both statistically and clinically significant for information retrieval, disease diagnosis and prognosis. The method offers the potential to substantially boost classification performance in biomedical machine learning tasks without necessitating an excessive volume of well-curated training data or strong data distribution and modeling assumptions in existing semi-supervised learning methods.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Machine LearningHumansCOVID-19Reproducibility of ResultsComputational BiologySARS-CoV-2Breast NeoplasmsAlgorithmsFemaleElectronic Health Records

Autor:innen und Institutionen

  • Department of Bioengineering, Stanford University, Stanford, California, United States of America.
  • Department of Biomedical Data Science, Stanford University, Stanford, California, United States of America.
  • Department of Medical Imaging, Jinling Hospital, Nanjing, Jiangsu, People's Republic of China.

ORCID-Profile: Xianghao Zhan, Olivier Gevaert

Förderung

  • NCI NIH HHS

Zitieren

APA

Zhan, X., Xu, Q., Zheng, Y., Lu, G., & Gevaert, O. (2025). Reliability-enhanced data cleaning in biomedical machine learning using inductive conformal prediction. PLOS Computational Biology. https://doi.org/10.1371/journal.pcbi.1012803

Vancouver

Zhan X, Xu Q, Zheng Y, Lu G, Gevaert O. Reliability-enhanced data cleaning in biomedical machine learning using inductive conformal prediction. PLOS Computational Biology. 2025. doi:10.1371/journal.pcbi.1012803

BibTeX
@article{Zhan2025,
  author = {Zhan, Xianghao and Xu, Qinmei and Zheng, Yuanning and Lu, Guangming and Gevaert, Olivier},
  title = {Reliability-enhanced data cleaning in biomedical machine learning using inductive conformal prediction},
  journal = {PLOS Computational Biology},
  year = {2025},
  doi = {10.1371/journal.pcbi.1012803}
}
Kostenlos starten →