EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Biobjective gradient descent for feature selection on high dimension, low sample size data

Tina Issa iD, Eric Angel, Farida Zehraoui iD

PLOS ONE · 2024

DOI: 10.1371/journal.pone.0305654 ↗

Kurz gefasst

Fachartikel in der Zeitschrift PLOS ONE, 2024. Verfasst von Tina Issa und 2 weiteren Autor:innen. Beteiligte Einrichtung: Universite Paris-Saclay, Univ Evry, IBISC, Evry-Courcouronnes, France. Hauptthemen laut MEDLINE: Neural Networks, Computer, Deep Learning. Die Arbeit wurde bisher 7-mal zitiert (Crossref) und nennt 44 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Even though deep learning shows impressive results in several applications, its use on problems with High Dimensions and Low Sample Size, such as diagnosing rare diseases, leads to overfitting. One solution often proposed is feature selection. In deep learning, along with feature selection, network sparsification is also used to improve the results when dealing with high dimensions low sample size data. However, most of the time, they are tackled as separate problems. This paper proposes a new approach that integrates feature selection, based on sparsification, into the training process of a deep neural network. This approach uses a constrained biobjective gradient descent method. It provides a set of Pareto optimal neural networks that make a trade-off between network sparsity and model accuracy. Results on both artificial and real datasets show that using a constrained biobjective gradient descent increases the network sparsity without degrading the classification performances. With the proposed approach, on an artificial dataset, the feature selection score reached 0.97 with a sparsity score of 0.92 with an accuracy of 0.9. For the same accuracy, none of the other methods reached a feature score above 0.20 and sparsity score of 0.35. Finally, statistical tests validate the results obtained on all datasets.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Neural Networks, ComputerDeep LearningSample SizeHumansAlgorithms

Autor:innen und Institutionen

  • Universite Paris-Saclay, Univ Evry, IBISC, Evry-Courcouronnes, France.

ORCID-Profile: Tina Issa, Farida Zehraoui

Zitieren

APA

Issa, T., Angel, E., & Zehraoui, F. (2024). Biobjective gradient descent for feature selection on high dimension, low sample size data. PLOS ONE. https://doi.org/10.1371/journal.pone.0305654

Vancouver

Issa T, Angel E, Zehraoui F. Biobjective gradient descent for feature selection on high dimension, low sample size data. PLOS ONE. 2024. doi:10.1371/journal.pone.0305654

BibTeX
@article{Issa2024,
  author = {Issa, Tina and Angel, Eric and Zehraoui, Farida},
  title = {Biobjective gradient descent for feature selection on high dimension, low sample size data},
  journal = {PLOS ONE},
  year = {2024},
  doi = {10.1371/journal.pone.0305654}
}
Kostenlos starten →