EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC 4.0

Adaptive Window Diffusion Decoding for Long-Context Language Generation Under Memory Constraints

Nina Petrov, Rafael Costa, Clara Hoffmann

International Journal of Advanced Engineering and Technology Research · 21.07.2026 · 2 (3) · 55-60

DOI: 10.54097/v7jevw42 ↗

Kurz gefasst

Fachartikel in der Zeitschrift International Journal of Advanced Engineering and Technology Research, online erschienen am 21.07.2026. Verfasst von Nina Petrov und 2 weiteren Autor:innen. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Masked diffusion language models (MDLMs) are attractive for long-form generation because they denoise all positions with bidirectional context, but this advantage also creates a severe inference-time memory bottleneck: each denoising step requires dense attention over the active sequence. Recent sliding-window and speculative wrappers have shown that the bottleneck can be reduced without retraining the base model. However, fixed window sizes remain inefficient under heterogeneous documents, where some regions require broad context and others can be decoded safely with smaller memory footprints. This paper proposes Adaptive Window Diffusion Decoding (AWDD), a memory-budgeted inference framework that adjusts window size, overlap commitment, and context-summary capacity according to observable uncertainty in the partially masked sequence. AWDD uses a lightweight dependency-pressure score, a bounded summary buffer, and confidence-aware overlap commitment to preserve long-range terms while keeping peak memory below a fixed budget. We derive the memory and computational bounds of the scheduler and provide a reproducible CPU benchmark rather than unsupported large-model claims. On a controlled long-range dependency benchmark and a real-text sanity set extracted from the uploaded SW-SpeedDLM article, AWDD improves long-range entity reconstruction over fixed-window baselines while using substantially less peak memory than a large fixed window. These results support adaptive windowing as a practical direction for memory-constrained diffusion decoding and provide code, raw results, and document-level figures for replication.

Zitieren

APA

Petrov, N., Costa, R., & Hoffmann, C. (2026). Adaptive Window Diffusion Decoding for Long-Context Language Generation Under Memory Constraints. International Journal of Advanced Engineering and Technology Research, 2(3), 55-60. https://doi.org/10.54097/v7jevw42

Vancouver

Petrov N, Costa R, Hoffmann C. Adaptive Window Diffusion Decoding for Long-Context Language Generation Under Memory Constraints. International Journal of Advanced Engineering and Technology Research. 2026;2(3):55-60. doi:10.54097/v7jevw42

BibTeX
@article{Petrov2026,
  author = {Petrov, Nina and Costa, Rafael and Hoffmann, Clara},
  title = {Adaptive Window Diffusion Decoding for Long-Context Language Generation Under Memory Constraints},
  journal = {International Journal of Advanced Engineering and Technology Research},
  year = {2026},
  volume = {2},
  number = {3},
  pages = {55--60},
  doi = {10.54097/v7jevw42}
}
Kostenlos starten →