Key Phrases Extraction Method Based on a New Ranking Function
Informacionnye Tehnologii · 09.09.2022 · 28 (9) · 456-474
DOI: 10.17587/it.28.465-474 ↗Kurz gefasst
Fachartikel in der Zeitschrift Informacionnye Tehnologii, erschienen am 09.09.2022. Verfasst von J. H. Mohammad und 3 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref).
Abstract (Originalsprache)
A new key phrases extraction method based on statistical approaches and contextual embedding models is proposed. The proposed method identifies the main candidate keywords for a document based on their frequencies and then weights them based on their similarity values to the document. The frequency of each type of n-gram is calculated independently to ensure fair competition between them at the ranking stage. In addition, to assess the importance of a candidate keyword in a document, context-based embeddings are used to represent both the document and its candidate keywords in preparation for assessing their similarity. To prevent bias in similarity values in long keywords, a function has been introduced to normalize similarity scores of each candidate based on its length. The final score for the importance of a keyword is determined by a score function that returns the harmonic mean of the frequency and the similarity. The proposed method is tested using five different benchmark datasets against several state-of-art baselines including TF-IDF, TextRank, and Yake. The proposed method outperforms all baselines in terms of the MAP@K ranking metric.
Zitieren
APA
Mohammad, J. H., Mansour, A. M., Kravchenko, Y. A., & Bova, V. V. (2022). Key Phrases Extraction Method Based on a New Ranking Function. Informacionnye Tehnologii, 28(9), 456-474. https://doi.org/10.17587/it.28.465-474
Vancouver
Mohammad JH, Mansour AM, Kravchenko YA, Bova VV. Key Phrases Extraction Method Based on a New Ranking Function. Informacionnye Tehnologii. 2022;28(9):456-474. doi:10.17587/it.28.465-474
BibTeX
@article{Mohammad2022,
author = {Mohammad, J. H. and Mansour, A. M. and Kravchenko, Y. A. and Bova, V. V.},
title = {Key Phrases Extraction Method Based on a New Ranking Function},
journal = {Informacionnye Tehnologii},
year = {2022},
volume = {28},
number = {9},
pages = {456--474},
doi = {10.17587/it.28.465-474}
}
EUVIMED