Optimizing SBERT for long text clustering: two novel approaches with empirical insights
The Journal of Supercomputing · 02.06.2025 · 81 (8)
DOI: 10.1007/s11227-025-07414-4 ↗Kurz gefasst
Fachartikel in der Zeitschrift The Journal of Supercomputing, online erschienen am 02.06.2025. Verfasst von Yasin Ortakci und 1 weiteren Autor:innen. Die Arbeit wurde bisher 21-mal zitiert (Crossref) und nennt 76 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Karabuk University.
Abstract (Originalsprache)
Transformer-based Large Language Models (LLMs), which have recently gained popularity, have significantly impacted the various fields of natural language processing. One of them is text clustering, which involves categorizing the huge texts produced by today’s digital world into meaningful groups. LLMs enable text clustering with a more semantic and contextualized approach than traditional methods. One such model is Sentence-BERT (SBERT), which has been modified to detect semantic similarity between texts. Before being clustered, texts need to be transformed into numerical text embeddings. SBERT-based models have shown promise in generating meaningful sentence embeddings. However, they face limitations when dealing with long texts that exceed their maximum token limit. In this context, this study proposes two distinct methods to overcome these limitations and enhance the performance of SBERT models for clustering long text. The proposed methods are combined with various SBERT models, and their combinations are compared to the existing default method on three datasets containing lengthy texts. This study evaluates the impact of these methods on the models and their contributions to clustering performance. The findings indicate that the proposed methods exhibit a higher clustering performance of up to 14% than the default method in text clustering. Additionally, this study provides valuable insights into the text clustering performance of SBERT models, offering practical implications for further research and applications.
Förderung
- Karabuk University
Zitieren
APA
Ortakci, Y., & Borhan, B. (2025). Optimizing SBERT for long text clustering: two novel approaches with empirical insights. The Journal of Supercomputing, 81(8). https://doi.org/10.1007/s11227-025-07414-4
Vancouver
Ortakci Y, Borhan B. Optimizing SBERT for long text clustering: two novel approaches with empirical insights. The Journal of Supercomputing. 2025;81(8). doi:10.1007/s11227-025-07414-4
BibTeX
@article{Ortakci2025,
author = {Ortakci, Yasin and Borhan, Burak},
title = {Optimizing SBERT for long text clustering: two novel approaches with empirical insights},
journal = {The Journal of Supercomputing},
year = {2025},
volume = {81},
number = {8},
doi = {10.1007/s11227-025-07414-4}
}
EUVIMED