Biobjective gradient descent for feature selection on high dimension, low sample size data
PLOS ONE · 2024
DOI: 10.1371/journal.pone.0305654 ↗Kurz gefasst
Fachartikel in der Zeitschrift PLOS ONE, 2024. Verfasst von Tina Issa und 2 weiteren Autor:innen. Beteiligte Einrichtung: Universite Paris-Saclay, Univ Evry, IBISC, Evry-Courcouronnes, France. Hauptthemen laut MEDLINE: Neural Networks, Computer, Deep Learning. Die Arbeit wurde bisher 7-mal zitiert (Crossref) und nennt 44 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Even though deep learning shows impressive results in several applications, its use on problems with High Dimensions and Low Sample Size, such as diagnosing rare diseases, leads to overfitting. One solution often proposed is feature selection. In deep learning, along with feature selection, network sparsification is also used to improve the results when dealing with high dimensions low sample size data. However, most of the time, they are tackled as separate problems. This paper proposes a new approach that integrates feature selection, based on sparsification, into the training process of a deep neural network. This approach uses a constrained biobjective gradient descent method. It provides a set of Pareto optimal neural networks that make a trade-off between network sparsity and model accuracy. Results on both artificial and real datasets show that using a constrained biobjective gradient descent increases the network sparsity without degrading the classification performances. With the proposed approach, on an artificial dataset, the feature selection score reached 0.97 with a sparsity score of 0.92 with an accuracy of 0.9. For the same accuracy, none of the other methods reached a feature score above 0.20 and sparsity score of 0.35. Finally, statistical tests validate the results obtained on all datasets.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Autor:innen und Institutionen
- Universite Paris-Saclay, Univ Evry, IBISC, Evry-Courcouronnes, France.
ORCID-Profile: Tina Issa, Farida Zehraoui
Zitieren
APA
Issa, T., Angel, E., & Zehraoui, F. (2024). Biobjective gradient descent for feature selection on high dimension, low sample size data. PLOS ONE. https://doi.org/10.1371/journal.pone.0305654
Vancouver
Issa T, Angel E, Zehraoui F. Biobjective gradient descent for feature selection on high dimension, low sample size data. PLOS ONE. 2024. doi:10.1371/journal.pone.0305654
BibTeX
@article{Issa2024,
author = {Issa, Tina and Angel, Eric and Zehraoui, Farida},
title = {Biobjective gradient descent for feature selection on high dimension, low sample size data},
journal = {PLOS ONE},
year = {2024},
doi = {10.1371/journal.pone.0305654}
}
EUVIMED