From Static to Contextual: A Survey of Embedding Advances in NLP
PERFECT: Journal of Smart Algorithms · 2025
DOI: 10.62671/perfect.v2i2.77 ↗Kurz gefasst
Fachartikel in der Zeitschrift PERFECT: Journal of Smart Algorithms, 2025. Verfasst von Hussein Alkaabi und 2 weiteren Autor:innen. Die Arbeit wurde bisher 11-mal zitiert (Crossref). Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0).
Abstract (Originalsprache)
Embedding techniques have been a cornerstone of Natural Language Processing (NLP), enabling machines to represent textual data in a form that captures semantic and syntactic relationships. Over the years, the field has witnessed a significant evolution—from static word embeddings, such as Word2Vec and GloVe, which represent words as fixed vectors, to dynamic, contextualized embeddings like BERT and GPT, which generate word representations based on their surrounding context. This survey provides a comprehensive overview of embedding techniques, tracing their development from early methods to state-of-the-art approaches. We discuss the strengths and limitations of each paradigm, their applications across various NLP tasks, and the challenges they address, such as polysemy and out-of-vocabulary words. Furthermore, we highlight emerging trends, including multimodal embeddings, domain-specific representations, and efforts to mitigate embedding bias. By synthesizing the advancements in this rapidly evolving field, this paper aims to serve as a valuable resource for researchers and practitioners while identifying open challenges and future directions for embedding research in NLP.
Zitieren
APA
Alkaabi, H., Jasim, A. K., & Darroudi, A. (2025). From Static to Contextual: A Survey of Embedding Advances in NLP. PERFECT: Journal of Smart Algorithms. https://doi.org/10.62671/perfect.v2i2.77
Vancouver
Alkaabi H, Jasim AK, Darroudi A. From Static to Contextual: A Survey of Embedding Advances in NLP. PERFECT: Journal of Smart Algorithms. 2025. doi:10.62671/perfect.v2i2.77
BibTeX
@article{Alkaabi2025,
author = {Alkaabi, Hussein and Jasim, Ali Kadhim and Darroudi, Ali},
title = {From Static to Contextual: A Survey of Embedding Advances in NLP},
journal = {PERFECT: Journal of Smart Algorithms},
year = {2025},
doi = {10.62671/perfect.v2i2.77}
}
EUVIMED