EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Analysis of Short Texts Using Intelligent Clustering Methods

Jamalbek Tussupov, Akmaral Kassymova, Ayagoz Mukhanova, Assyl Bissengaliyeva, Zhanar Azhibekova, Moldir Yessenova, Zhanargul Abuova

Algorithms · 19.05.2025 · 18 (5) · 289

DOI: 10.3390/a18050289 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Algorithms, online erschienen am 19.05.2025. Verfasst von Jamalbek Tussupov und 6 weiteren Autor:innen. Die Arbeit wurde bisher 5-mal zitiert (Crossref) und nennt 32 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Science Committee of the Ministry of Science and Higher Education of the Republic of Kazakhstan.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

This article presents a comprehensive review of short text clustering using state-of-the-art methods: Bidirectional Encoder Representations from Transformers (BERT), Term Frequency-Inverse Document Frequency (TF-IDF), and the novel hybrid method Latent Dirichlet Allocation + BERT + Autoencoder (LDA + BERT + AE). The article begins by outlining the theoretical foundation of each technique and its merits and limitations. BERT is critiqued for its ability to understand word dependence in text, while TF-IDF is lauded for its applicability in terms of importance assessment. The experimental section compares the efficacy of these methods in clustering short texts, with a specific focus on the hybrid LDA + BERT + AE approach. A detailed examination of the LDA-BERT model’s training and validation loss over 200 epochs shows that the loss values start above 1.2 and quickly decrease to around 0.8 within the first 25 epochs, eventually stabilizing at approximately 0.4. The close alignment of these curves suggests the model’s practical learning and generalization capabilities, with minimal overfitting. The study demonstrates that the hybrid LDA + BERT + AE method significantly enhances text clustering quality compared to individual methods. Based on the findings, the study recommends the optimum choice and use of clustering methods for different short texts and natural language processing operations. The applications of these methods in industrial and educational settings, where successful text handling and categorization are critical, are also addressed. The study ends by emphasizing the importance of the holistic handling of short texts for deeper semantic comprehension and effective information retrieval.

Förderung

  • Science Committee of the Ministry of Science and Higher Education of the Republic of Kazakhstan

Zitieren

APA

Tussupov, J., Kassymova, A., Mukhanova, A., Bissengaliyeva, A., Azhibekova, Z., Yessenova, M., & Abuova, Z. (2025). Analysis of Short Texts Using Intelligent Clustering Methods. Algorithms, 18(5), 289. https://doi.org/10.3390/a18050289

Vancouver

Tussupov J, Kassymova A, Mukhanova A, Bissengaliyeva A, Azhibekova Z, Yessenova M, et al. Analysis of Short Texts Using Intelligent Clustering Methods. Algorithms. 2025;18(5):289. doi:10.3390/a18050289

BibTeX
@article{Tussupov2025,
  author = {Tussupov, Jamalbek and Kassymova, Akmaral and Mukhanova, Ayagoz and Bissengaliyeva, Assyl and Azhibekova, Zhanar and Yessenova, Moldir and Abuova, Zhanargul},
  title = {Analysis of Short Texts Using Intelligent Clustering Methods},
  journal = {Algorithms},
  year = {2025},
  volume = {18},
  number = {5},
  pages = {289},
  doi = {10.3390/a18050289}
}
Kostenlos starten →