EUVIMEDEUVIMED entdecken
Crossref

On the Equivalence of Linear Discriminant Analysis and Least Squares Regression

Feiping Nie, Hong Chen, Shiming Xiang, Changshui Zhang, Shuicheng Yan, Xuelong Li

IEEE Transactions on Neural Networks and Learning Systems · 2024-04 · 35 (4) · 5710-5720

DOI: 10.1109/tnnls.2022.3208944 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Neural Networks and Learning Systems, 2024-04. Verfasst von Feiping Nie und 5 weiteren Autor:innen. Die Arbeit wurde bisher 5-mal zitiert (Crossref) und nennt 39 Literaturangaben. Gefördert von: National Key Research and Development Program of China, Natural Science Basic Research Program of Shaanxi, National Natural Science Foundation of China.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Studying the relationship between linear discriminant analysis (LDA) and least squares regression (LSR) is of great theoretical and practical significance. It is well-known that the two-class LDA is equivalent to an LSR problem, and directly casting multiclass LDA as an LSR problem, however, becomes more challenging. Recent study reveals that the equivalence between multiclass LDA and LSR can be established based on a special class indicator matrix, but under a mild condition which may not hold under the scenarios with low-dimensional or oversampled data. In this article, we show that the equivalence between multiclass LDA and LSR can be established based on arbitrary linearly independent class indicator vectors and without any condition. In addition, we show that LDA is also equivalent to a constrained LSR based on the data-dependent indicator vectors. It can be concluded that under exactly the same mild condition, such two regressions are both equivalent to the null space LDA method. Illuminated by the equivalence of LDA and LSR, we propose a direct LDA classifier to replace the conventional framework of LDA plus extra classifier. Extensive experiments well validate the above theoretic analysis.

Förderung

  • National Key Research and Development Program of China
  • Natural Science Basic Research Program of Shaanxi
  • National Natural Science Foundation of China
  • Fundamental Research Funds for the Central Universities

Zitieren

APA

Nie, F., Chen, H., Xiang, S., Zhang, C., Yan, S., & Li, X. (2024). On the Equivalence of Linear Discriminant Analysis and Least Squares Regression. IEEE Transactions on Neural Networks and Learning Systems, 35(4), 5710-5720. https://doi.org/10.1109/tnnls.2022.3208944

Vancouver

Nie F, Chen H, Xiang S, Zhang C, Yan S, Li X. On the Equivalence of Linear Discriminant Analysis and Least Squares Regression. IEEE Transactions on Neural Networks and Learning Systems. 2024;35(4):5710-5720. doi:10.1109/tnnls.2022.3208944

BibTeX
@article{Nie2024,
  author = {Nie, Feiping and Chen, Hong and Xiang, Shiming and Zhang, Changshui and Yan, Shuicheng and Li, Xuelong},
  title = {On the Equivalence of Linear Discriminant Analysis and Least Squares Regression},
  journal = {IEEE Transactions on Neural Networks and Learning Systems},
  year = {2024},
  volume = {35},
  number = {4},
  pages = {5710--5720},
  doi = {10.1109/tnnls.2022.3208944}
}
Kostenlos starten →