EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

ConKgPrompt: Contrastive Sample Method Based on Knowledge-Guided Prompt Learning for Text Classification

Qian Wang, Cheng Zeng, Bing Li, Peng He

Electronics · 30.08.2023 · 12 (17) · 3656

DOI: 10.3390/electronics12173656 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Electronics, online erschienen am 30.08.2023. Verfasst von Qian Wang und 3 weiteren Autor:innen. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 37 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Key R & D projects in Hubei Province, National Natural Science Foundation of China, Science and Technology Innovation Program of Hubei Province.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Text classification aims to classify text according to pre-defined categories. Despite the success of existing methods based on the fine-tuning paradigm, there is a significant gap between fine-tuning and pre-training. Currently, prompt learning methods can bring state of the art (SOTA) performance to pre-trained language models (PLMs) in text classification and transform a classification problem into a masked language modeling problem. The crucial step of prompt learning is to construct a map between original labels and the label extension words. However, most mapping construction methods consider only labels themselves; relying solely on a label is not sufficient to achieve accurate prediction of mask tokens, especially in classification tasks where semantic features and label words are highly interrelated. Therefore, the accurate prediction of mask tokens requires one to consider additional factors beyond just label words. To this end, we propose a contrastive sample method based on knowledge-guided prompt learning framework (ConKgPrompt) for text classification. Specifically, this framework utilizes external knowledge bases (KBs) to expand the label vocabulary of verbalizers at multiple granularities. In the contrastive sample module, we incorporate supervised contrastive learning to make representations more expressive. Our approach was validated on four benchmark datasets, and extensive experimental results and analysis demonstrated the effectiveness of each module of the ConKgPrompt method.

Förderung

  • Key R & D projects in Hubei Province
  • National Natural Science Foundation of China
  • Science and Technology Innovation Program of Hubei Province

Zitieren

APA

Wang, Q., Zeng, C., Li, B., & He, P. (2023). ConKgPrompt: Contrastive Sample Method Based on Knowledge-Guided Prompt Learning for Text Classification. Electronics, 12(17), 3656. https://doi.org/10.3390/electronics12173656

Vancouver

Wang Q, Zeng C, Li B, He P. ConKgPrompt: Contrastive Sample Method Based on Knowledge-Guided Prompt Learning for Text Classification. Electronics. 2023;12(17):3656. doi:10.3390/electronics12173656

BibTeX
@article{Wang2023,
  author = {Wang, Qian and Zeng, Cheng and Li, Bing and He, Peng},
  title = {ConKgPrompt: Contrastive Sample Method Based on Knowledge-Guided Prompt Learning for Text Classification},
  journal = {Electronics},
  year = {2023},
  volume = {12},
  number = {17},
  pages = {3656},
  doi = {10.3390/electronics12173656}
}
Kostenlos starten →