EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Knowledge-Enhanced Prompt Learning for Few-Shot Text Classification

Jinshuo Liu, Lu Yang

Big Data and Cognitive Computing · 18.04.2024 · 8 (4) · 43

DOI: 10.3390/bdcc8040043 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Big Data and Cognitive Computing, online erschienen am 18.04.2024. Verfasst von Jinshuo Liu und 1 weiteren Autor:innen. Die Arbeit wurde bisher 11-mal zitiert (Crossref) und nennt 41 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Classification methods based on fine-tuning pre-trained language models often require a large number of labeled samples; therefore, few-shot text classification has attracted considerable attention. Prompt learning is an effective method for addressing few-shot text classification tasks in low-resource settings. The essence of prompt tuning is to insert tokens into the input, thereby converting a text classification task into a masked language modeling problem. However, constructing appropriate prompt templates and verbalizers remains challenging, as manual prompts often require expert knowledge, while auto-constructing prompts is time-consuming. In addition, the extensive knowledge contained in entities and relations should not be ignored. To address these issues, we propose a structured knowledge prompt tuning (SKPT) method, which is a knowledge-enhanced prompt tuning approach. Specifically, SKPT includes three components: prompt template, prompt verbalizer, and training strategies. First, we insert virtual tokens into the prompt template based on open triples to introduce external knowledge. Second, we use an improved knowledgeable verbalizer to expand and filter the label words. Finally, we use structured knowledge constraints during the training phase to optimize the model. Through extensive experiments on few-shot text classification tasks with different settings, the effectiveness of our model has been demonstrated.

Förderung

  • National Natural Science Foundation of China

Zitieren

APA

Liu, J., & Yang, L. (2024). Knowledge-Enhanced Prompt Learning for Few-Shot Text Classification. Big Data and Cognitive Computing, 8(4), 43. https://doi.org/10.3390/bdcc8040043

Vancouver

Liu J, Yang L. Knowledge-Enhanced Prompt Learning for Few-Shot Text Classification. Big Data and Cognitive Computing. 2024;8(4):43. doi:10.3390/bdcc8040043

BibTeX
@article{Liu2024,
  author = {Liu, Jinshuo and Yang, Lu},
  title = {Knowledge-Enhanced Prompt Learning for Few-Shot Text Classification},
  journal = {Big Data and Cognitive Computing},
  year = {2024},
  volume = {8},
  number = {4},
  pages = {43},
  doi = {10.3390/bdcc8040043}
}
Kostenlos starten →