EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC 4.0

Evaluating Word Similarity Measure of Embeddings Through Binary Classification

A. Aziz Altowayan, Lixin Tao

Journal of Computer Science Research · 2019

DOI: 10.30564/jcsr.v1i3.1268 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Computer Science Research, 2019. Verfasst von A. Aziz Altowayan und 1 weiteren Autor:innen. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

We consider the following problem: given neural language models (embeddings) each of which is trained on an unknown data set, how can we determine which model would provide a better result when used for feature representation in a downstream task such as text classification or entity recognition? In this paper, we assess the word similarity measure through analyzing its impact on word embeddings learned from various datasets and how they perform in a simple classification task. Word representations were learned and assessed under the same conditions. For training word vectors, we used the implementation of Continuous Bag of Words described in [1]. To assess the quality of the vectors, we applied the analogy questions test for word similarity described in the same paper. Further, to measure the retrieval rate of an embedding model, we introduced a new metric (Average Retrieval Error) which measures the percentage of missing words in the model. We observe that scoring a high accuracy of syntactic and semantic similarities between word pairs is not an indicator of better classification results. This observation can be justified by the fact that a domain-specific corpus contributes to the performance better than a general-purpose corpus. For reproducibility, we release our experiments scripts and results.

Zitieren

APA

Altowayan, A. A., & Tao, L. (2019). Evaluating Word Similarity Measure of Embeddings Through Binary Classification. Journal of Computer Science Research. https://doi.org/10.30564/jcsr.v1i3.1268

Vancouver

Altowayan AA, Tao L. Evaluating Word Similarity Measure of Embeddings Through Binary Classification. Journal of Computer Science Research. 2019. doi:10.30564/jcsr.v1i3.1268

BibTeX
@article{Altowayan2019,
  author = {Altowayan, A. Aziz and Tao, Lixin},
  title = {Evaluating Word Similarity Measure of Embeddings Through Binary Classification},
  journal = {Journal of Computer Science Research},
  year = {2019},
  doi = {10.30564/jcsr.v1i3.1268}
}
Kostenlos starten →