An Effective Optimization Method for Fuzzy k-Means With Entropy Regularization
IEEE Transactions on Knowledge and Data Engineering · 2024-07 · 36 (7) · 2846-2861
DOI: 10.1109/tkde.2023.3329821 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Knowledge and Data Engineering, 2024-07. Verfasst von Yun Liang und 4 weiteren Autor:innen. Die Arbeit wurde bisher 5-mal zitiert (Crossref) und nennt 57 Literaturangaben. Gefördert von: Guangzhou Key Research and Development Project, National Natural Science Foundation of China, Special Fund for Rural Revitalization Strategy of Guangdong.
Abstract (Originalsprache)
Fuzzy $k$ k -Means with Entropy Regularization method (ERFKM) is an extension to Fuzzy $k$ k -Means (FKM) by introducing a maximum entropy term to FKM, whose purpose is trading off fuzziness and compactness. However, ERFKM often converges to a poor local minimum, which affects its performance. In this paper, we propose an effective optimization method to solve this problem, called IRW-ERFKM. First a new equivalent problem for ERFKM is proposed; then we solve it through Iteratively Re-Weighted (IRW) method. Since IRW-ERFKM optimizes the problem with $k\times 1$ k × 1 instead of $d\times k$ d × k intermediate variables, the space complexity of IRW-ERFKM is greatly reduced. Extensive experiments on clustering performance and objective function value show IRW-ERFKM can get a better local minimum than ERFKM with fewer iterations. Through time complexity analysis, it verifies IRW-ERFKM and ERFKM have the same linear time complexity. Moreover, IRW-ERFKM has advantages on evaluation metrics compared with other methods. What's more, there are two interesting findings. One is when we use IRW method to solve the equivalent problem of ERFKM with one factor $\mathbf{U}$ U , it is equivalent to ERFKM. The other is when the inner loop of IRW-ERFKM is executed only once, IRW-ERFKM and ERFKM are equivalent in this case.
Förderung
- Guangzhou Key Research and Development Project
- National Natural Science Foundation of China
- Special Fund for Rural Revitalization Strategy of Guangdong
Zitieren
APA
Liang, Y., Chen, Y., Huang, Q., Chen, H., & Nie, F. (2024). An Effective Optimization Method for Fuzzy k-Means With Entropy Regularization. IEEE Transactions on Knowledge and Data Engineering, 36(7), 2846-2861. https://doi.org/10.1109/tkde.2023.3329821
Vancouver
Liang Y, Chen Y, Huang Q, Chen H, Nie F. An Effective Optimization Method for Fuzzy k-Means With Entropy Regularization. IEEE Transactions on Knowledge and Data Engineering. 2024;36(7):2846-2861. doi:10.1109/tkde.2023.3329821
BibTeX
@article{Liang2024,
author = {Liang, Yun and Chen, Yijin and Huang, Qiong and Chen, Haoming and Nie, Feiping},
title = {An Effective Optimization Method for Fuzzy k-Means With Entropy Regularization},
journal = {IEEE Transactions on Knowledge and Data Engineering},
year = {2024},
volume = {36},
number = {7},
pages = {2846--2861},
doi = {10.1109/tkde.2023.3329821}
}
EUVIMED