EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC-ND 4.0

Towards Explainable Graph Spectral Clustering for BERT Embeddings

Mieczysław Kłopotek, Sławomir T. Wierzchoń, Bartłomiej Starosta, Piotr Borkowski, Dariusz Czerski

Journal of Automation, Mobile Robotics and Intelligent Systems · 25.03.2026 · 53-65

DOI: 10.14313/jamris-2026-005 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Automation, Mobile Robotics and Intelligent Systems, online erschienen am 25.03.2026. Verfasst von Mieczysław Kłopotek und 4 weiteren Autor:innen. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Artificial Intelligence algorithms are increasingly applied to tasks in Natural Language Processing, including document clustering. As these algorithms become increasingly complex (such as transformer-based embeddings, like BERT) and/or are of a ``black-box'' nature, such as Graph Spectral Clustering (GSC) algorithms, the demand for explaining the results of such algorithms is becoming increasingly urgent. In this paper, we propose a model-aware method to explain the results of GSC in the context of BERT-based embeddings. We present a novel theoretical methodology for explanation, based on the premise that document similarity in GSC is computed as cosine similarity of BERT embeddings of documents. We demonstrate the validity of this methodology by presenting strong GSC clustering results, restoring the human-made assignment of hashtags to tweets. We show that GSC based on BERT embeddings outperforms approaches using Term Vector Space and GloVe embeddings. Therefore, the resulting explanations are also expected to be of higher quality.

Zitieren

APA

Kłopotek, M., Wierzchoń, S. T., Starosta, B., Borkowski, P., & Czerski, D. (2026). Towards Explainable Graph Spectral Clustering for BERT Embeddings. Journal of Automation, Mobile Robotics and Intelligent Systems, 53-65. https://doi.org/10.14313/jamris-2026-005

Vancouver

Kłopotek M, Wierzchoń ST, Starosta B, Borkowski P, Czerski D. Towards Explainable Graph Spectral Clustering for BERT Embeddings. Journal of Automation, Mobile Robotics and Intelligent Systems. 2026:53-65. doi:10.14313/jamris-2026-005

BibTeX
@article{Kopotek2026,
  author = {Kłopotek, Mieczysław and Wierzchoń, Sławomir T. and Starosta, Bartłomiej and Borkowski, Piotr and Czerski, Dariusz},
  title = {Towards Explainable Graph Spectral Clustering for BERT Embeddings},
  journal = {Journal of Automation, Mobile Robotics and Intelligent Systems},
  year = {2026},
  pages = {53--65},
  doi = {10.14313/jamris-2026-005}
}
Kostenlos starten →