EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Large Language Models Enable Few-Shot Clustering

Vijay Viswanathan, Kiril Gashteovski, Kiril Gashteovski, Carolin Lawrence, Tongshuang Wu, Graham Neubig

Transactions of the Association for Computational Linguistics · 05.04.2024 · 12 · 321-333

DOI: 10.1162/tacl_a_00648 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Transactions of the Association for Computational Linguistics, online erschienen am 05.04.2024. Verfasst von Vijay Viswanathan und 5 weiteren Autor:innen. Die Arbeit wurde bisher 76-mal zitiert (Crossref) und nennt 40 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Unlike traditional unsupervised clustering, semi-supervised clustering allows users to provide meaningful structure to the data, which helps the clustering algorithm to match the user’s intent. Existing approaches to semi-supervised clustering require a significant amount of feedback from an expert to improve the clusters. In this paper, we ask whether a large language model (LLM) can amplify an expert’s guidance to enable query-efficient, few-shot semi-supervised text clustering. We show that LLMs are surprisingly effective at improving clustering. We explore three stages where LLMs can be incorporated into clustering: before clustering (improving input features), during clustering (by providing constraints to the clusterer), and after clustering (using LLMs post-correction). We find that incorporating LLMs in the first two stages routinely provides significant improvements in cluster quality, and that LLMs enable a user to make trade-offs between cost and accuracy to produce desired clusters. We release our code and LLM prompts for the public to use.1

Zitieren

APA

Viswanathan, V., Gashteovski, K., Gashteovski, K., Lawrence, C., Wu, T., & Neubig, G. (2024). Large Language Models Enable Few-Shot Clustering. Transactions of the Association for Computational Linguistics, 12, 321-333. https://doi.org/10.1162/tacl_a_00648

Vancouver

Viswanathan V, Gashteovski K, Gashteovski K, Lawrence C, Wu T, Neubig G. Large Language Models Enable Few-Shot Clustering. Transactions of the Association for Computational Linguistics. 2024;12:321-333. doi:10.1162/tacl_a_00648

BibTeX
@article{Viswanathan2024,
  author = {Viswanathan, Vijay and Gashteovski, Kiril and Gashteovski, Kiril and Lawrence, Carolin and Wu, Tongshuang and Neubig, Graham},
  title = {Large Language Models Enable Few-Shot Clustering},
  journal = {Transactions of the Association for Computational Linguistics},
  year = {2024},
  volume = {12},
  pages = {321--333},
  doi = {10.1162/tacl_a_00648}
}
Kostenlos starten →