Dynamic Multi-Granularity Translation System: DAG-Structured Multi-Granularity Representation and Self-Attention
Systems · 09.10.2024 · 12 (10) · 420
DOI: 10.3390/systems12100420 ↗Kurz gefasst
Fachartikel in der Zeitschrift Systems, online erschienen am 09.10.2024. Verfasst von Shenrong Lv und 7 weiteren Autor:innen. Die Arbeit wurde bisher 40-mal zitiert (Crossref) und nennt 32 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Sichuan Science and Technology Program.
Abstract (Originalsprache)
In neural machine translation (NMT), the sophistication of word embeddings plays a pivotal role in the model’s ability to render accurate and contextually relevant translations. However, conventional models with single granularity of word segmentation cannot fully embed complex languages like Chinese, where the granularity of segmentation significantly impacts understanding and translation fidelity. Addressing these challenges, our study introduces the Dynamic Multi-Granularity Translation System (DMGTS), an innovative approach that enhances the Transformer model by incorporating multi-granularity position encoding and multi-granularity self-attention mechanisms. Leveraging a Directed Acyclic Graph (DAG), the DMGTS utilizes four levels of word segmentation for multi-granularity position encoding. Dynamic word embeddings are also introduced to enhance the lexical representation by incorporating multi-granularity features. Multi-granularity self-attention mechanisms are applied to replace the conventional self-attention layers. We evaluate the DMGTS on multiple datasets, where our system demonstrates marked improvements. Notably, it achieves significant enhancements in translation quality, evidenced by increases of 1.16 and 1.55 in Bilingual Evaluation Understudy (BLEU) scores over traditional static embedding methods. These results underscore the efficacy of the DMGTS in refining NMT performance.
Förderung
- Sichuan Science and Technology Program
Zitieren
APA
Lv, S., Yang, B., Wang, R., Lu, S., Tian, J., Zheng, W., Chen, X., & Yin, L. (2024). Dynamic Multi-Granularity Translation System: DAG-Structured Multi-Granularity Representation and Self-Attention. Systems, 12(10), 420. https://doi.org/10.3390/systems12100420
Vancouver
Lv S, Yang B, Wang R, Lu S, Tian J, Zheng W, et al. Dynamic Multi-Granularity Translation System: DAG-Structured Multi-Granularity Representation and Self-Attention. Systems. 2024;12(10):420. doi:10.3390/systems12100420
BibTeX
@article{Lv2024,
author = {Lv, Shenrong and Yang, Bo and Wang, Ruiyang and Lu, Siyu and Tian, Jiawei and Zheng, Wenfeng and Chen, Xiaobing and Yin, Lirong},
title = {Dynamic Multi-Granularity Translation System: DAG-Structured Multi-Granularity Representation and Self-Attention},
journal = {Systems},
year = {2024},
volume = {12},
number = {10},
pages = {420},
doi = {10.3390/systems12100420}
}
EUVIMED