Sparse Minimum Redundancy Maximum Relevance for Feature Selection
Scandinavian Journal of Statistics · 2026-09 · 53 (3) · 1134-1151
DOI: 10.1111/sjos.70074 ↗Kurz gefasst
Fachartikel in der Zeitschrift Scandinavian Journal of Statistics, online erschienen am 15.05.2026. Verfasst von Peter Naylor und 3 weiteren Autor:innen. Die Arbeit nennt 48 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0). Gefördert von: Japan Society for the Promotion of Science, RIKEN.
Abstract (Originalsprache)
We propose a feature screening method that integrates both feature–feature and feature–target relationships. Inactive features are identified via a penalized minimum Redundancy Maximum Relevance (mRMR) procedure, which is the continuous version of the classical mRMR penalized by a non‐convex regularizer, and where the parameters estimated as zero coefficients represent the set of inactive features. We establish the conditions under which zero coefficients are correctly identified to guarantee accurate recovery of inactive features. We introduce a multi‐stage procedure based on the knockoff filter that enables the penalized mRMR to discard inactive features while controlling the false discovery rate (FDR). Our method performs comparably to HSIC‐LASSO but is more conservative in the number of selected features. It only requires setting an FDR threshold, rather than specifying the number of features to retain. The effectiveness of the method is illustrated through simulations and real‐world datasets. The code to reproduce this work is available on the following GitHub: https://github.com/PeterJackNaylor/SmRMR .
Förderung
- Japan Society for the Promotion of Science
- RIKEN
Zitieren
APA
Naylor, P., Poignard, B., Climente‐González, H., & Yamada, M. (2026). Sparse Minimum Redundancy Maximum Relevance for Feature Selection. Scandinavian Journal of Statistics, 53(3), 1134-1151. https://doi.org/10.1111/sjos.70074
Vancouver
Naylor P, Poignard B, Climente‐González H, Yamada M. Sparse Minimum Redundancy Maximum Relevance for Feature Selection. Scandinavian Journal of Statistics. 2026;53(3):1134-1151. doi:10.1111/sjos.70074
BibTeX
@article{Naylor2026,
author = {Naylor, Peter and Poignard, Benjamin and Climente‐González, Héctor and Yamada, Makoto},
title = {Sparse Minimum Redundancy Maximum Relevance for Feature Selection},
journal = {Scandinavian Journal of Statistics},
year = {2026},
volume = {53},
number = {3},
pages = {1134--1151},
doi = {10.1111/sjos.70074}
}
EUVIMED