EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Leveraging Temporal Down-Sampling Structure and Spatio-Temporal Fusion for Efficient Video Coding

Keren He iD, Yufei Gao iD, Qi Wang iD, Haixin Wang iD, Jinjia Zhou iD

Sensors · 28.02.2026 · 26 (5) · 1522

DOI: 10.3390/s26051522 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Sensors, online erschienen am 28.02.2026. Verfasst von Keren He und 4 weiteren Autor:innen. Beteiligte Einrichtung: Graduate School of Science and Engineering, Hosei University, Tokyo 184-8584, Japan. Die Arbeit nennt 64 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: JSPS KAKENHI.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Down-sampling-based video compression frameworks have shown great potential in improving compression efficiency in modern sensing and imaging systems. However, existing methods ignore critical spatial and temporal redundancy, and treat all frames uniformly during down-sampling. This leads to the loss of important information and impacts compression efficiency. To address these limitations, this paper proposes a temporal down-sampling system, in which only intermediate frames are down-sampled while preserving key frames with high quality for reference. On the decoding side, we employ a frame-recurrent enhancement mechanism to maximize the use of temporal redundancy information. In the fusion of enhancement stage, we design a Multi-scale Temporal-Spatial Attention (MTSA) module. MTSA consists of two components: Multi-Temporal Attention (MTA) and Pyramid Spatial Attention (PSA). MTA performs multi-scale temporal correlation modeling, expanding the receptive field and providing stable cues in compressed regions. PSA integrates local spatial saliency and contextual structure in a progressive and multi-stage manner. Extensive experiments show that our approach achieves consistent BD-rate reductions. Under All-Intra, Low-Delay-P, and Random Access configurations, we observe BD-rate reductions of I, P, and B frames ranging from 14% to 39% compared to VVC, and outperform prior approaches anchored by the standard HEVC.

Schlagwörter

Stichwörter der Autor:innen

deep learninglow-bitratevideo codingvideo enhancement

Autor:innen und Institutionen

  • Graduate School of Science and Engineering, Hosei University, Tokyo 184-8584, Japan.

ORCID-Profile: Keren He, Yufei Gao, Qi Wang, Haixin Wang, Jinjia Zhou

Förderung

  • JSPS KAKENHI

Zitieren

APA

He, K., Gao, Y., Wang, Q., Wang, H., & Zhou, J. (2026). Leveraging Temporal Down-Sampling Structure and Spatio-Temporal Fusion for Efficient Video Coding. Sensors, 26(5), 1522. https://doi.org/10.3390/s26051522

Vancouver

He K, Gao Y, Wang Q, Wang H, Zhou J. Leveraging Temporal Down-Sampling Structure and Spatio-Temporal Fusion for Efficient Video Coding. Sensors. 2026;26(5):1522. doi:10.3390/s26051522

BibTeX
@article{He2026,
  author = {He, Keren and Gao, Yufei and Wang, Qi and Wang, Haixin and Zhou, Jinjia},
  title = {Leveraging Temporal Down-Sampling Structure and Spatio-Temporal Fusion for Efficient Video Coding},
  journal = {Sensors},
  year = {2026},
  volume = {26},
  number = {5},
  pages = {1522},
  doi = {10.3390/s26051522}
}
Kostenlos starten →