EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Dynamic Multi-Granularity Translation System: DAG-Structured Multi-Granularity Representation and Self-Attention

Shenrong Lv, Bo Yang, Ruiyang Wang, Siyu Lu, Jiawei Tian, Wenfeng Zheng, Xiaobing Chen, Lirong Yin

Systems · 09.10.2024 · 12 (10) · 420

DOI: 10.3390/systems12100420 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Systems, online erschienen am 09.10.2024. Verfasst von Shenrong Lv und 7 weiteren Autor:innen. Die Arbeit wurde bisher 40-mal zitiert (Crossref) und nennt 32 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Sichuan Science and Technology Program.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

In neural machine translation (NMT), the sophistication of word embeddings plays a pivotal role in the model’s ability to render accurate and contextually relevant translations. However, conventional models with single granularity of word segmentation cannot fully embed complex languages like Chinese, where the granularity of segmentation significantly impacts understanding and translation fidelity. Addressing these challenges, our study introduces the Dynamic Multi-Granularity Translation System (DMGTS), an innovative approach that enhances the Transformer model by incorporating multi-granularity position encoding and multi-granularity self-attention mechanisms. Leveraging a Directed Acyclic Graph (DAG), the DMGTS utilizes four levels of word segmentation for multi-granularity position encoding. Dynamic word embeddings are also introduced to enhance the lexical representation by incorporating multi-granularity features. Multi-granularity self-attention mechanisms are applied to replace the conventional self-attention layers. We evaluate the DMGTS on multiple datasets, where our system demonstrates marked improvements. Notably, it achieves significant enhancements in translation quality, evidenced by increases of 1.16 and 1.55 in Bilingual Evaluation Understudy (BLEU) scores over traditional static embedding methods. These results underscore the efficacy of the DMGTS in refining NMT performance.

Förderung

  • Sichuan Science and Technology Program

Zitieren

APA

Lv, S., Yang, B., Wang, R., Lu, S., Tian, J., Zheng, W., Chen, X., & Yin, L. (2024). Dynamic Multi-Granularity Translation System: DAG-Structured Multi-Granularity Representation and Self-Attention. Systems, 12(10), 420. https://doi.org/10.3390/systems12100420

Vancouver

Lv S, Yang B, Wang R, Lu S, Tian J, Zheng W, et al. Dynamic Multi-Granularity Translation System: DAG-Structured Multi-Granularity Representation and Self-Attention. Systems. 2024;12(10):420. doi:10.3390/systems12100420

BibTeX
@article{Lv2024,
  author = {Lv, Shenrong and Yang, Bo and Wang, Ruiyang and Lu, Siyu and Tian, Jiawei and Zheng, Wenfeng and Chen, Xiaobing and Yin, Lirong},
  title = {Dynamic Multi-Granularity Translation System: DAG-Structured Multi-Granularity Representation and Self-Attention},
  journal = {Systems},
  year = {2024},
  volume = {12},
  number = {10},
  pages = {420},
  doi = {10.3390/systems12100420}
}
Kostenlos starten →