Enabling interpretable machine learning for biological data with reliability scores
PLOS Computational Biology · 26.05.2023 · 19 (5) · e1011175
DOI: 10.1371/journal.pcbi.1011175 ↗Kurz gefasst
Fachartikel in der Zeitschrift PLOS Computational Biology, online erschienen am 26.05.2023. Verfasst von K D Ahlquist und 2 weiteren Autor:innen. Beteiligte Einrichtung: Center for Computational Molecular Biology, Brown University, Providence, Rhode Island, United States of America. Hauptthemen laut MEDLINE: Machine Learning, Genome. Die Arbeit wurde bisher 25-mal zitiert (Crossref) und nennt 68 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: NIGMS NIH HHS, NIH, Wimmer Family Foundation.
Abstract (Originalsprache)
Machine learning tools have proven useful across biological disciplines, allowing researchers to draw conclusions from large datasets, and opening up new opportunities for interpreting complex and heterogeneous biological data. Alongside the rapid growth of machine learning, there have also been growing pains: some models that appear to perform well have later been revealed to rely on features of the data that are artifactual or biased; this feeds into the general criticism that machine learning models are designed to optimize model performance over the creation of new biological insights. A natural question arises: how do we develop machine learning models that are inherently interpretable or explainable? In this manuscript, we describe the SWIF(r) reliability score (SRS), a method building on the SWIF(r) generative framework that reflects the trustworthiness of the classification of a specific instance. The concept of the reliability score has the potential to generalize to other machine learning methods. We demonstrate the utility of the SRS when faced with common challenges in machine learning including: 1) an unknown class present in testing data that was not present in training data, 2) systemic mismatch between training and testing data, and 3) instances of testing data that have missing values for some attributes. We explore these applications of the SRS using a range of biological datasets, from agricultural data on seed morphology, to 22 quantitative traits in the UK Biobank, and population genetic simulations and 1000 Genomes Project data. With each of these examples, we demonstrate how the SRS can allow researchers to interrogate their data and training approach thoroughly, and to pair their domain-specific knowledge with powerful machine-learning frameworks. We also compare the SRS to related tools for outlier and novelty detection, and find that it has comparable performance, with the advantage of being able to operate when some data are missing. The SRS, and the broader discussion of interpretable scientific machine learning, will aid researchers in the biological machine learning space as they seek to harness the power of machine learning without sacrificing rigor and biological insight.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Autor:innen und Institutionen
- Center for Computational Molecular Biology, Brown University, Providence, Rhode Island, United States of America.
- Department of Molecular Biology, Cell Biology, and Biochemistry, Brown University, Providence, Rhode Island, United States of America.
- Department of Mathematics and Computer Science, Duquesne University, Pittsburgh, Pennsylvania, United States of America.
- Department of Ecology, Evolution and Organismal Biology, Brown University, Providence, Rhode Island, United States of America.
- Data Science Initiative, Brown University, Providence, Rhode Island, United States of America.
ORCID-Profile: K D Ahlquist, Lauren A Sugden, Sohini Ramachandran
Förderung
- NIGMS NIH HHS
- NIH
- Wimmer Family Foundation
Zitieren
APA
Ahlquist, K. D., Sugden, L. A., & Ramachandran, S. (2023). Enabling interpretable machine learning for biological data with reliability scores. PLOS Computational Biology, 19(5), e1011175. https://doi.org/10.1371/journal.pcbi.1011175
Vancouver
Ahlquist KD, Sugden LA, Ramachandran S. Enabling interpretable machine learning for biological data with reliability scores. PLOS Computational Biology. 2023;19(5):e1011175. doi:10.1371/journal.pcbi.1011175
BibTeX
@article{Ahlquist2023,
author = {Ahlquist, K D and Sugden, Lauren A and Ramachandran, Sohini},
title = {Enabling interpretable machine learning for biological data with reliability scores},
journal = {PLOS Computational Biology},
year = {2023},
volume = {19},
number = {5},
pages = {e1011175},
doi = {10.1371/journal.pcbi.1011175}
}
EUVIMED