Named Entity Recognition for Few-Shot Power Dispatch Based on Multi-Task
Electronics · 17.08.2023 · 12 (16) · 3476
DOI: 10.3390/electronics12163476 ↗Kurz gefasst
Fachartikel in der Zeitschrift Electronics, online erschienen am 17.08.2023. Verfasst von Zhixiang Tan und 4 weiteren Autor:innen. Die Arbeit wurde bisher 9-mal zitiert (Crossref) und nennt 29 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Guangxi Scientific Research and Technology Development Plan Project, Innovation Project of China Southern Power Grid Co., Ltd..
Abstract (Originalsprache)
In view of the fact that entity nested and professional terms are difficult to identify in the field of power dispatch, a multi-task-based few-shot named entity recognition model (FSPD-NER) for power dispatch is proposed. The model consists of four modules: feature enhancement, seed, expansion, and implication. Firstly, the masking strategy of the encoder is improved by adopting whole-word masking, using a RoBERTa (Robustly Optimized BERT Pretraining Approach) encoder as the embedding layer to obtain the text feature representation, and an IDCNN (Iterated Dilated CNN) module to enhance the feature. Then the text is cut into one Chinese character and two Chinese characters as a seed set, the score for each seed is calculated, and if the score is greater than the threshold value ω, they are passed to the expansion module as candidate seeds; next, the candidate seeds need to be expanded left and right according to offset γ to obtain the candidate entities; finally, to construct text implication pairs, the input text is used as a premise sentence, the candidate entity is connected with predefined label templates as hypothesis sentences, and the implication pairs are passed to the RoBERTa encoder for the classification task. The focus loss function is used to alleviate label imbalance during training. The experimental results of the model on the power dispatch dataset show that the precision, recall, and F1 scores of the recognition results in 20-shot samples are 63.39%, 61.97%, and 62.67%, respectively, which is a significant performance improvement compared to existing methods.
Förderung
- Guangxi Scientific Research and Technology Development Plan Project
- Innovation Project of China Southern Power Grid Co., Ltd.
Zitieren
APA
Tan, Z., Chen, Y., Liang, Z., Meng, Q., & Lin, D. (2023). Named Entity Recognition for Few-Shot Power Dispatch Based on Multi-Task. Electronics, 12(16), 3476. https://doi.org/10.3390/electronics12163476
Vancouver
Tan Z, Chen Y, Liang Z, Meng Q, Lin D. Named Entity Recognition for Few-Shot Power Dispatch Based on Multi-Task. Electronics. 2023;12(16):3476. doi:10.3390/electronics12163476
BibTeX
@article{Tan2023,
author = {Tan, Zhixiang and Chen, Yan and Liang, Zengfu and Meng, Qi and Lin, Dezhao},
title = {Named Entity Recognition for Few-Shot Power Dispatch Based on Multi-Task},
journal = {Electronics},
year = {2023},
volume = {12},
number = {16},
pages = {3476},
doi = {10.3390/electronics12163476}
}
EUVIMED