Combining statistical, structural, and linguistic features for keyword extraction from web pages
Applied Computing and Intelligence · 2022
DOI: 10.3934/aci.2022007 ↗Kurz gefasst
Fachartikel in der Zeitschrift Applied Computing and Intelligence, 2022. Verfasst von Himat Shah und 1 weiteren Autor:innen. Die Arbeit wurde bisher 7-mal zitiert (Crossref) und nennt 36 Literaturangaben.
Abstract (Originalsprache)
Keywords are commonly used to summarize text documents. In this paper, we perform a systematic comparison of methods for automatic keyword extraction from web pages. The methods are based on three different types of features: statistical, structural and linguistic. Statistical features are the most common, but there are other clues in web documents that can also be used. Structural features utilize styling codes like header tags and links, but also the structure of the web page. Linguistic features can be based on detecting synonyms, semantic similarity of the words and part-of-speech tagging, but also concept hierarchy or a concept graph derived from Wikipedia. We compare different types of features to find out the importance of each of them. One of the key results is that stop word removal and other pre-processing steps are the most critical. The most successful linguistic feature was a pre-constructed list of words that had no synonyms in WordNet. A new method called ACI‑rank is also compiled from the best working combination.
Zitieren
APA
Shah, H., & Fränti, P. (2022). Combining statistical, structural, and linguistic features for keyword extraction from web pages. Applied Computing and Intelligence. https://doi.org/10.3934/aci.2022007
Vancouver
Shah H, Fränti P. Combining statistical, structural, and linguistic features for keyword extraction from web pages. Applied Computing and Intelligence. 2022. doi:10.3934/aci.2022007
BibTeX
@article{Shah2022,
author = {Shah, Himat and Fränti, Pasi},
title = {Combining statistical, structural, and linguistic features for keyword extraction from web pages},
journal = {Applied Computing and Intelligence},
year = {2022},
doi = {10.3934/aci.2022007}
}
EUVIMED