EUVIMEDEUVIMED entdecken
Crossref

Low‐Latency English Writing Assistance via End‐Edge‐Cloud Collaborative Inference

Wanying Chen

Internet Technology Letters · 2026-03 · 9 (2)

DOI: 10.1002/itl2.70254 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Internet Technology Letters, online erschienen am 10.03.2026. Verfasst von Wanying Chen. Die Arbeit nennt 18 Literaturangaben.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The deployment of Large Language Models (LLMs) in real‐time English Writing Assistance (EWA) is often hindered by the conflicting requirements of high linguistic precision and low interaction latency. Traditional cloud‐centric or end‐side deployment paradigms suffer from either significant network delays or degraded generation quality due to hardware constraints. In this paper, we propose a low‐latency collaborative inference framework that integrates end, edge, and cloud resources. We introduce a semantic‐complexity aware gating mechanism that dynamically routes queries based on linguistic difficulty, alongside an asynchronous speculative parallelism architecture to mask transmission overhead. Experimental results on WikiText‐103, CNN/DailyMail, SQuAD 2.0, and the CoNLL‐2014 Grammatical Error Correction benchmarks demonstrate that our framework reduces end‐to‐end latency by up to 75% and energy consumption by 39% compared to cloud‐only baselines, while maintaining over 98% of the original model's accuracy. By effectively balancing computational loads and network jitter, the proposed system provides a scalable solution for responsive and high‐quality LLM‐driven intelligent writing services.

Zitieren

APA

Chen, W. (2026). Low‐Latency English Writing Assistance via End‐Edge‐Cloud Collaborative Inference. Internet Technology Letters, 9(2). https://doi.org/10.1002/itl2.70254

Vancouver

Chen W. Low‐Latency English Writing Assistance via End‐Edge‐Cloud Collaborative Inference. Internet Technology Letters. 2026;9(2). doi:10.1002/itl2.70254

BibTeX
@article{Chen2026,
  author = {Chen, Wanying},
  title = {Low‐Latency English Writing Assistance via End‐Edge‐Cloud Collaborative Inference},
  journal = {Internet Technology Letters},
  year = {2026},
  volume = {9},
  number = {2},
  doi = {10.1002/itl2.70254}
}
Kostenlos starten →