Rank selection for non‐negative matrix factorization
Statistics in Medicine · 30.12.2023 · 42 (30) · 5676-5693
DOI: 10.1002/sim.9934 ↗Kurz gefasst
Fachartikel in der Zeitschrift Statistics in Medicine, online erschienen am 17.10.2023. Verfasst von Yun Cai und 2 weiteren Autor:innen. Beteiligte Einrichtung: Department of Mathematics and Statistics, Dalhousie University, Halifax, Canada. Hauptthemen laut MEDLINE: Algorithms, Microbiota. Die Arbeit wurde bisher 16-mal zitiert (Crossref) und nennt 47 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0). Gefördert von: Natural Sciences and Engineering Research Council of Canada.
Abstract (Originalsprache)
Non‐Negative Matrix Factorization (NMF) is a widely used dimension reduction method that factorizes a non‐negative data matrix into two lower dimensional non‐negative matrices: one is the basis or feature matrix which consists of the variables and the other is the coefficients matrix which is the projections of data points to the new basis. The features can be interpreted as sub‐structures of the data. The number of sub‐structures in the feature matrix is also called the rank. This parameter controls the model complexity and is the only tuning parameter for the NMF model. An appropriate rank will extract the key latent features while minimizing the noise from the original data. However due to the large amount of optimization error always present in the NMF computation, the rank selection has been a difficult problem. We develop a novel rank selection method based on hypothesis testing, using a deconvolved bootstrap distribution to assess the significance level accurately. Through simulations, we compare our method with a rank selection method based on hypothesis testing using bootstrap distribution without deconvolution and a method based on cross‐validation; we demonstrate that our method is not only accurate at estimating the true ranks for NMF, especially when the features are hard to distinguish, but also efficient at computation. When applied to real microbiome data (eg, OTU data and functional metagenomic data), our method also shows the ability to extract interpretable subcommunities in the data.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Mathematics and Statistics, Dalhousie University, Halifax, Canada.
ORCID-Profile: Yun Cai, Toby Kenney
Förderung
- Natural Sciences and Engineering Research Council of Canada
Zitieren
APA
Cai, Y., Gu, H., & Kenney, T. (2023). Rank selection for non‐negative matrix factorization. Statistics in Medicine, 42(30), 5676-5693. https://doi.org/10.1002/sim.9934
Vancouver
Cai Y, Gu H, Kenney T. Rank selection for non‐negative matrix factorization. Statistics in Medicine. 2023;42(30):5676-5693. doi:10.1002/sim.9934
BibTeX
@article{Cai2023,
author = {Cai, Yun and Gu, Hong and Kenney, Toby},
title = {Rank selection for non‐negative matrix factorization},
journal = {Statistics in Medicine},
year = {2023},
volume = {42},
number = {30},
pages = {5676--5693},
doi = {10.1002/sim.9934}
}
EUVIMED