EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Cluster-SCP: Similarity and Contrastive Learning to Enhance Pseudo Labels for Fine Tuning under Few Labels

Abdullah Alsuhaibani, Abdulrahman Alalawi, Imran Razzak, Shoaib Jameel, Xianzhi Wang, Guandong Xu

World Wide Web · 2026-01 · 29 (3)

DOI: 10.1007/s11280-026-01415-w ↗

Kurz gefasst

Fachartikel in der Zeitschrift World Wide Web, online erschienen am 16.04.2026. Verfasst von Abdullah Alsuhaibani und 5 weiteren Autor:innen. Die Arbeit nennt 55 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: University of Technology Sydney.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Language models often underperform when fine tuned with limited labelled data. To reduce dependence on costly annotation, recent studies have explored clustering and pseudo labelling to leverage unlabeled text with only a few labelled examples for fine tuning. However, these methods face persistent challenges: clustering errors and pseudo-label mismatches can degrade fine-tuning performance. We propose Cluster-SCP , a novel framework that improves intra-cluster coherence and reduces cluster quantity to generate more reliable pseudo labels. The framework begins with K-Means initialization and applies an iterative refinement process, Intermediate Pseudo Labels , comprising two stages: embedding reassignment to minimize clustering errors, and cluster merging via contrastive learning with graph readouts. The refined pseudo labels are first used to fine tune language model, which is subsequently refined using a small set of labels. Experiments on three benchmark datasets show that Cluster-SCP consistently outperforms baseline and state-of-the-art methods, achieving at least a 5.3% accuracy improvement while reducing the number of clusters by 22%.

Förderung

  • University of Technology Sydney

Zitieren

APA

Alsuhaibani, A., Alalawi, A., Razzak, I., Jameel, S., Wang, X., & Xu, G. (2026). Cluster-SCP: Similarity and Contrastive Learning to Enhance Pseudo Labels for Fine Tuning under Few Labels. World Wide Web, 29(3). https://doi.org/10.1007/s11280-026-01415-w

Vancouver

Alsuhaibani A, Alalawi A, Razzak I, Jameel S, Wang X, Xu G. Cluster-SCP: Similarity and Contrastive Learning to Enhance Pseudo Labels for Fine Tuning under Few Labels. World Wide Web. 2026;29(3). doi:10.1007/s11280-026-01415-w

BibTeX
@article{Alsuhaibani2026,
  author = {Alsuhaibani, Abdullah and Alalawi, Abdulrahman and Razzak, Imran and Jameel, Shoaib and Wang, Xianzhi and Xu, Guandong},
  title = {Cluster-SCP: Similarity and Contrastive Learning to Enhance Pseudo Labels for Fine Tuning under Few Labels},
  journal = {World Wide Web},
  year = {2026},
  volume = {29},
  number = {3},
  doi = {10.1007/s11280-026-01415-w}
}
Kostenlos starten →