Question to Question Similarity Analysis Using Morphological, Syntactic, Semantic, and Lexical Features
JUCS - Journal of Universal Computer Science · 28.06.2020 · 26 (6) · 671-697
DOI: 10.3897/jucs.2020.036 ↗Kurz gefasst
Fachartikel in der Zeitschrift JUCS - Journal of Universal Computer Science, online erschienen am 28.06.2020. Verfasst von Mahmoud Hammad und 6 weiteren Autor:innen. Die Arbeit wurde bisher 3-mal zitiert (Crossref). Der Volltext ist frei zugänglich (Open Access, CC BY-ND 4.0).
Abstract (Originalsprache)
In the digitally connected world that we are living in, people expect to get answers to their questions spontaneously. This expectation increased the burden on Question/Answer platforms such as Stack Overflow and many others. A promising solution to this problem is to detect if a question being asked is similar to a question in the database, then present the answer of the detected question to the user. To address this challenge, we propose a novel Natural Language Processing (NLP) approach that detects if two Arabic questions are similar or not using their extracted morphological, syntactic, semantic, lexical, overlapping, and semantic lexical features. Our approach involves several phases including Arabic text processing, novel feature extraction, and text classifications. Moreover, we conducted a comparison between seven different machine learning classifiers. The included classifiers are: Support Vector Machine (SVM), Decision Tree (DT), Logistic Regression (LR), Extreme Gradient Boosting (XGB), Random Forests (RF), Adaptive Boosting (AdaBoost), and Multilayer Perceptron (MLP). To conduct our experiments, we used a real-world questions dataset consisting of around 19,136 questions (9,568 pairs of questions) in which our approach achieved 82.93% accuracy using our XGB model on the best features selected by the Random Forest feature selection technique. This high accuracy of our model shows the ability of our approach to correctly detect similar Arabic questions and hence increases user satisfactions.
Zitieren
APA
Hammad, M., Al-Smadi, M., Baker, Q., D, M., Al-Khdour, N., Younes, M., & Khwaileh, E. (2020). Question to Question Similarity Analysis Using Morphological, Syntactic, Semantic, and Lexical Features. JUCS - Journal of Universal Computer Science, 26(6), 671-697. https://doi.org/10.3897/jucs.2020.036
Vancouver
Hammad M, Al-Smadi M, Baker Q, D M, Al-Khdour N, Younes M, et al. Question to Question Similarity Analysis Using Morphological, Syntactic, Semantic, and Lexical Features. JUCS - Journal of Universal Computer Science. 2020;26(6):671-697. doi:10.3897/jucs.2020.036
BibTeX
@article{Hammad2020,
author = {Hammad, Mahmoud and Al-Smadi, Mohammad and Baker, Qanita and D, Muntaha and Al-Khdour, Nour and Younes, Mutaz and Khwaileh, Enas},
title = {Question to Question Similarity Analysis Using Morphological, Syntactic, Semantic, and Lexical Features},
journal = {JUCS - Journal of Universal Computer Science},
year = {2020},
volume = {26},
number = {6},
pages = {671--697},
doi = {10.3897/jucs.2020.036}
}
EUVIMED