Research on Public Service Request Text Classification Based on BERT-BiLSTM-CNN Feature Fusion
Applied Sciences · 18.07.2024 · 14 (14) · 6282
DOI: 10.3390/app14146282 ↗Kurz gefasst
Fachartikel in der Zeitschrift Applied Sciences, online erschienen am 18.07.2024. Verfasst von Yunpeng Xiong und 2 weiteren Autor:innen. Die Arbeit wurde bisher 20-mal zitiert (Crossref) und nennt 29 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: 2024 Hainan Province Higher Education Teaching Reform Research Project, Hainan Province key research and development plan.
Abstract (Originalsprache)
Convolutional neural networks (CNNs) face challenges in capturing long-distance text correlations, and Bidirectional Long Short-Term Memory (BiLSTM) networks exhibit limited feature extraction capabilities for text classification of public service requests. To address the abovementioned problems, this work utilizes an ensemble learning approach to integrate model elements efficiently. This study presents a method for classifying public service request text using a hybrid neural network model called BERT-BiLSTM-CNN. First, BERT (Bidirectional Encoder Representations from Transformers) is used for preprocessing to obtain text vector representations. Then, context and process sequence information are captured through BiLSTM. Next, local features in the text are captured through CNN. Finally, classification results are obtained through Softmax. Through comparative analysis, the method of fusing these three models is superior to other hybrid neural network model architectures in multiple classification tasks. It has a significant effect on public service request text classification.
Förderung
- 2024 Hainan Province Higher Education Teaching Reform Research Project
- Hainan Province key research and development plan
Zitieren
APA
Xiong, Y., Chen, G., & Cao, J. (2024). Research on Public Service Request Text Classification Based on BERT-BiLSTM-CNN Feature Fusion. Applied Sciences, 14(14), 6282. https://doi.org/10.3390/app14146282
Vancouver
Xiong Y, Chen G, Cao J. Research on Public Service Request Text Classification Based on BERT-BiLSTM-CNN Feature Fusion. Applied Sciences. 2024;14(14):6282. doi:10.3390/app14146282
BibTeX
@article{Xiong2024,
author = {Xiong, Yunpeng and Chen, Guolian and Cao, Junkuo},
title = {Research on Public Service Request Text Classification Based on BERT-BiLSTM-CNN Feature Fusion},
journal = {Applied Sciences},
year = {2024},
volume = {14},
number = {14},
pages = {6282},
doi = {10.3390/app14146282}
}
EUVIMED