EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Non‐Autoregressive Translation Algorithm Based on LLM Knowledge Distillation in English Corpus

Fang Ju, Weihui Wang

Engineering Reports · 2025-01 · 7 (1)

DOI: 10.1002/eng2.13077 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Engineering Reports, online erschienen am 08.12.2024. Verfasst von Fang Ju und 1 weiteren Autor:innen. Die Arbeit wurde bisher 3-mal zitiert (Crossref) und nennt 35 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Although significant advancements have been made in the quality of machine translation by large‐scale language models, their high computational costs and resource consumption have hindered their widespread adoption in practical applications. So this research introduces an English corpus‐based machine translation algorithm that leverages knowledge distillation from large language model, with the goal of enhancing translation quality and reducing the computational demands of the model. Initially, we conducted a thorough analysis of the English corpus to identify prevalent language patterns and structures. Following this, we developed a knowledge distillation approach that transfers the translation expertise of a large teacher model to a smaller student model, thereby achieving increased translation accuracy and efficiency. We designed a dynamic temperature hyperparameter distillation strategy that effectively enhances the precision of translations. In the experimental phase, we utilized several standard English corpora to train and assess our algorithm. The findings indicate that, compared to current machine translation systems, our method significantly reduces the need for computational resources while preserving translation quality.

Zitieren

APA

Ju, F., & Wang, W. (2025). Non‐Autoregressive Translation Algorithm Based on LLM Knowledge Distillation in English Corpus. Engineering Reports, 7(1). https://doi.org/10.1002/eng2.13077

Vancouver

Ju F, Wang W. Non‐Autoregressive Translation Algorithm Based on LLM Knowledge Distillation in English Corpus. Engineering Reports. 2025;7(1). doi:10.1002/eng2.13077

BibTeX
@article{Ju2025,
  author = {Ju, Fang and Wang, Weihui},
  title = {Non‐Autoregressive Translation Algorithm Based on LLM Knowledge Distillation in English Corpus},
  journal = {Engineering Reports},
  year = {2025},
  volume = {7},
  number = {1},
  doi = {10.1002/eng2.13077}
}
Infokarte | EUVIMED

Artikeldaten derzeit nicht verfügbar.

Recherche