Multi-Class Document Classification Using Lexical Ontology-Based Deep Learning
Applied Sciences · 17.05.2023 · 13 (10) · 6139
DOI: 10.3390/app13106139 ↗Kurz gefasst
Fachartikel in der Zeitschrift Applied Sciences, online erschienen am 17.05.2023. Verfasst von Ilkay Yelmen und 2 weiteren Autor:innen. Die Arbeit wurde bisher 20-mal zitiert (Crossref) und nennt 69 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: TUBITAK (2011-C Priority Areas Graduate Programme Scholarship).
Abstract (Originalsprache)
With the recent growth of the Internet, the volume of data has also increased. In particular, the increase in the amount of unstructured data makes it difficult to manage data. Classification is also needed in order to be able to use the data for various purposes. Since it is difficult to manually classify the ever-increasing volume data for the purpose of various types of analysis and evaluation, automatic classification methods are needed. In addition, the performance of imbalanced and multi-class classification is a challenging task. As the number of classes increases, so does the number of decision boundaries a learning algorithm has to solve. Therefore, in this paper, an improvement model is proposed using WordNet lexical ontology and BERT to perform deeper learning on the features of text, thereby improving the classification effect of the model. It was observed that classification success increased when using WordNet 11 general lexicographer files based on synthesis sets, syntactic categories, and logical groupings. WordNet was used for feature dimension reduction. In experimental studies, word embedding methods were used without dimension reduction. Afterwards, Random Forest (RF), Support Vector Machine (SVM) and Multi-Layer Perceptron (MLP) algorithms were employed to perform classification. These studies were then repeated with dimension reduction performed by WordNet. In addition to the machine learning model, experiments were also conducted with the pretrained BERT model with and without WordNet. The experimental results showed that, on an unstructured, seven-class, imbalanced dataset, the highest accuracy value of 93.77% was obtained when using our proposed model.
Förderung
- TUBITAK (2011-C Priority Areas Graduate Programme Scholarship)
Zitieren
APA
Yelmen, I., Gunes, A., & Zontul, M. (2023). Multi-Class Document Classification Using Lexical Ontology-Based Deep Learning. Applied Sciences, 13(10), 6139. https://doi.org/10.3390/app13106139
Vancouver
Yelmen I, Gunes A, Zontul M. Multi-Class Document Classification Using Lexical Ontology-Based Deep Learning. Applied Sciences. 2023;13(10):6139. doi:10.3390/app13106139
BibTeX
@article{Yelmen2023,
author = {Yelmen, Ilkay and Gunes, Ali and Zontul, Metin},
title = {Multi-Class Document Classification Using Lexical Ontology-Based Deep Learning},
journal = {Applied Sciences},
year = {2023},
volume = {13},
number = {10},
pages = {6139},
doi = {10.3390/app13106139}
}
EUVIMED