EUVIMEDEUVIMED entdecken
Open Access · CC BY-ND 4.0

Question to Question Similarity Analysis Using Morphological, Syntactic, Semantic, and Lexical Features

Mahmoud Hammad, Mohammad Al-Smadi, Qanita Baker, Muntaha D, Nour Al-Khdour, Mutaz Younes, Enas Khwaileh

JUCS - Journal of Universal Computer Science · 28.06.2020 · 26 (6) · 671-697

DOI: 10.3897/jucs.2020.036 ↗

Kurz gefasst

Fachartikel in der Zeitschrift JUCS - Journal of Universal Computer Science, online erschienen am 28.06.2020. Verfasst von Mahmoud Hammad und 6 weiteren Autor:innen. Die Arbeit wurde bisher 3-mal zitiert (Crossref). Der Volltext ist frei zugänglich (Open Access, CC BY-ND 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

In the digitally connected world that we are living in, people expect to get answers to their questions spontaneously. This expectation increased the burden on Question/Answer platforms such as Stack Overflow and many others. A promising solution to this problem is to detect if a question being asked is similar to a question in the database, then present the answer of the detected question to the user. To address this challenge, we propose a novel Natural Language Processing (NLP) approach that detects if two Arabic questions are similar or not using their extracted morphological, syntactic, semantic, lexical, overlapping, and semantic lexical features. Our approach involves several phases including Arabic text processing, novel feature extraction, and text classifications. Moreover, we conducted a comparison between seven different machine learning classifiers. The included classifiers are: Support Vector Machine (SVM), Decision Tree (DT), Logistic Regression (LR), Extreme Gradient Boosting (XGB), Random Forests (RF), Adaptive Boosting (AdaBoost), and Multilayer Perceptron (MLP). To conduct our experiments, we used a real-world questions dataset consisting of around 19,136 questions (9,568 pairs of questions) in which our approach achieved 82.93% accuracy using our XGB model on the best features selected by the Random Forest feature selection technique. This high accuracy of our model shows the ability of our approach to correctly detect similar Arabic questions and hence increases user satisfactions.

Zitieren

APA

Hammad, M., Al-Smadi, M., Baker, Q., D, M., Al-Khdour, N., Younes, M., & Khwaileh, E. (2020). Question to Question Similarity Analysis Using Morphological, Syntactic, Semantic, and Lexical Features. JUCS - Journal of Universal Computer Science, 26(6), 671-697. https://doi.org/10.3897/jucs.2020.036

Vancouver

Hammad M, Al-Smadi M, Baker Q, D M, Al-Khdour N, Younes M, et al. Question to Question Similarity Analysis Using Morphological, Syntactic, Semantic, and Lexical Features. JUCS - Journal of Universal Computer Science. 2020;26(6):671-697. doi:10.3897/jucs.2020.036

BibTeX
@article{Hammad2020,
  author = {Hammad, Mahmoud and Al-Smadi, Mohammad and Baker, Qanita and D, Muntaha and Al-Khdour, Nour and Younes, Mutaz and Khwaileh, Enas},
  title = {Question to Question Similarity Analysis Using Morphological, Syntactic, Semantic, and Lexical Features},
  journal = {JUCS - Journal of Universal Computer Science},
  year = {2020},
  volume = {26},
  number = {6},
  pages = {671--697},
  doi = {10.3897/jucs.2020.036}
}
Kostenlos starten →