EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC-ND 4.0

Comment text clustering algorithm based on improved DEC

Chen Kejia, Xia Ruidong, Lin Hongxi

Scientific Insights and Discoveries Review · 2024

DOI: 10.59782/sidr.v1i1.49 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Scientific Insights and Discoveries Review, 2024. Verfasst von Chen Kejia und 2 weiteren Autor:innen. Die Arbeit nennt 29 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Aiming at the problem that the initial number of clusters and cluster centers obtained by the clustering layer in the original deep embedding clustering (DEC) algorithm are highly random, thus affecting the effect of the DEC algorithm, a comment text clustering algorithm based on improved DEC is proposed to perform unsupervised clustering on e-commerce comment data without category annotations. Firstly, the vectorized representation of the BERT-LDA dataset that integrates sentence embedding vectors and topic distribution vectors is obtained; then the DEC algorithm is improved, and the dimension reduction is performed through an autoencoder. A clustering layer is stacked after the encoder, in which the number of clusters in the clustering layer is selected based on topic coherence, and the topic feature vector is used as a custom clustering center. The encoder and clustering layer are then jointly trained to improve the accuracy of clustering; finally, the clustering effect is intuitively displayed using a visualization tool. To verify the effectiveness of the algorithm, the algorithm is compared with 6 comparison algorithms for unsupervised clustering training on an unlabeled product review dataset. The results show that the algorithm achieves the best results of 0.2135 and 2958.18 in the silhouette coefficient and Calinski-Harabaz index, respectively. This shows that it can effectively process e-commerce review data and reflect users' attention to products.

Zitieren

APA

Kejia, C., Ruidong, X., & Hongxi, L. (2024). Comment text clustering algorithm based on improved DEC. Scientific Insights and Discoveries Review. https://doi.org/10.59782/sidr.v1i1.49

Vancouver

Kejia C, Ruidong X, Hongxi L. Comment text clustering algorithm based on improved DEC. Scientific Insights and Discoveries Review. 2024. doi:10.59782/sidr.v1i1.49

BibTeX
@article{Kejia2024,
  author = {Kejia, Chen and Ruidong, Xia and Hongxi, Lin},
  title = {Comment text clustering algorithm based on improved DEC},
  journal = {Scientific Insights and Discoveries Review},
  year = {2024},
  doi = {10.59782/sidr.v1i1.49}
}
Kostenlos starten →