WCC-EC 2.0: Enhancing Neural Machine Translation with a 1.6M+ Web-Crawled English-Chinese Parallel Corpus
Electronics · 05.04.2024 · 13 (7) · 1381
DOI: 10.3390/electronics13071381 ↗Kurz gefasst
Fachartikel in der Zeitschrift Electronics, online erschienen am 05.04.2024. Verfasst von Jinyi Zhang und 3 weiteren Autor:innen. Die Arbeit wurde bisher 5-mal zitiert (Crossref) und nennt 46 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: General Young Talents Project for Scientific Research grant of the Educational Department of Liaoning Province, Research Support Program for Inviting High-Level Talents grant of Shenyang Ligong University, China Scholarship Council.
Abstract (Originalsprache)
This research introduces WCC-EC 2.0 (Web-Crawled Corpus—English and Chinese), a comprehensive parallel corpus designed for enhancing Neural Machine Translation (NMT), featuring over 1.6 million English-Chinese sentence pairs meticulously gathered via web crawling. This corpus, extracted through an advanced web crawler, showcases the vast linguistic diversity and richness of English and Chinese, uniquely spanning the rarely covered news and music domains. Our methodical approach in web crawling and corpus assembly, coupled with rigorous experiments and manual evaluations, demonstrated its superiority by achieving high BLEU scores, marking significant strides in translation accuracy and model resilience. Its inclusion of these specific areas adds significant value, providing a unique dataset that enriches the scope for NMT research and development. With the rise of NMT technology, WCC-EC 2.0 emerges not only as an invaluable resource for researchers and developers, but also as a pivotal tool for improving translation accuracy, training more resilient models, and promoting interlingual communication.
Förderung
- General Young Talents Project for Scientific Research grant of the Educational Department of Liaoning Province
- Research Support Program for Inviting High-Level Talents grant of Shenyang Ligong University
- China Scholarship Council
Zitieren
APA
Zhang, J., Su, K., Tian, Y., & Matsumoto, T. (2024). WCC-EC 2.0: Enhancing Neural Machine Translation with a 1.6M+ Web-Crawled English-Chinese Parallel Corpus. Electronics, 13(7), 1381. https://doi.org/10.3390/electronics13071381
Vancouver
Zhang J, Su K, Tian Y, Matsumoto T. WCC-EC 2.0: Enhancing Neural Machine Translation with a 1.6M+ Web-Crawled English-Chinese Parallel Corpus. Electronics. 2024;13(7):1381. doi:10.3390/electronics13071381
BibTeX
@article{Zhang2024,
author = {Zhang, Jinyi and Su, Ke and Tian, Ye and Matsumoto, Tadahiro},
title = {WCC-EC 2.0: Enhancing Neural Machine Translation with a 1.6M+ Web-Crawled English-Chinese Parallel Corpus},
journal = {Electronics},
year = {2024},
volume = {13},
number = {7},
pages = {1381},
doi = {10.3390/electronics13071381}
}
EUVIMED