EUVIMEDOpdag EUVIMED
Crossref

A Brief Overview of Universal Sentence Representation Methods: A Linguistic View

Ruiqi Li, Xiang Zhao, Marie-Francine Moens

ACM Computing Surveys · 2023-03-31 · 55 (3) · 1-42

DOI: 10.1145/3482853 ↗

At a glance

Journal article in ACM Computing Surveys, published online on 2022-03-26. Written by Ruiqi Li and 2 co-authors. Cited 14 times so far (Crossref); 164 references. Funded by: NSFC, NSF of Hunan Province, Science and Technology Innovation Program of Hunan Province.

AbstractBibliografiske oplysningerCiteRelated studies

Abstract (original language)

How to transfer the semantic information in a sentence to a computable numerical embedding form is a fundamental problem in natural language processing. An informative universal sentence embedding can greatly promote subsequent natural language processing tasks. However, unlike universal word embeddings, a widely accepted general-purpose sentence embedding technique has not been developed. This survey summarizes the current universal sentence-embedding methods, categorizes them into four groups from a linguistic view, and ultimately analyzes their reported performance. Sentence embeddings trained from words in a bottom-up manner are observed to have different, nearly opposite, performance patterns in downstream tasks compared to those trained from logical relationships between sentences. By comparing differences of training schemes in and between groups, we analyze possible essential reasons for different performance patterns. We additionally collect incentive strategies handling sentences from other models and propose potentially inspiring future research directions.

Funding

  • NSFC
  • NSF of Hunan Province
  • Science and Technology Innovation Program of Hunan Province
  • European Research Council

Cite

APA

Li, R., Zhao, X., & Moens, M. (2023). A Brief Overview of Universal Sentence Representation Methods: A Linguistic View. ACM Computing Surveys, 55(3), 1-42. https://doi.org/10.1145/3482853

Vancouver

Li R, Zhao X, Moens M. A Brief Overview of Universal Sentence Representation Methods: A Linguistic View. ACM Computing Surveys. 2023;55(3):1-42. doi:10.1145/3482853

BibTeX
@article{Li2023,
  author = {Li, Ruiqi and Zhao, Xiang and Moens, Marie-Francine},
  title = {A Brief Overview of Universal Sentence Representation Methods: A Linguistic View},
  journal = {ACM Computing Surveys},
  year = {2023},
  volume = {55},
  number = {3},
  pages = {1--42},
  doi = {10.1145/3482853}
}
Start for free →