EUVIMEDEUVIMED entdecken
Crossref

IVP: An Intelligent Video Processing Architecture for Video Streaming

Chengsi Gao, Ying Wang, Yinhe Han, Weiwei Chen, Lei Zhang

IEEE Transactions on Computers · 01.01.2023 · 72 (1) · 264-277

DOI: 10.1109/tc.2022.3155950 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Computers, erschienen am 01.01.2023. Verfasst von Chengsi Gao und 4 weiteren Autor:innen. Die Arbeit wurde bisher 5-mal zitiert (Crossref) und nennt 35 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Strategic Priority Research Program of Chinese Academy of Sciences, Zhejiang Lab.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Recently, video processing tasks, such as video enhancement and analysis, have received increasing attention from both academics and industries. However, the current video processing procedure on edge decouples the decoding phase and the subsequent video processing tasks, missing the opportunity to accelerate the procedure by orchestrating video decoding and enhancement stages. Thus, we propose an intelligent video processing workflow and architecture(IVP) for cloud-edge video streaming. For edge devices that receive compressed videos, IVP can perform direct DNN-based video enhancement, e.g., super-resolution and frame-interpolation. By leveraging the metadata motion vectors and residuals extracted from the encoded video, our architecture will significantly eliminate unnecessary frame pixels being processed by the DNNs and improve execution efficiency. The proposed IVP and workflow are proved to reduce up to 90% of the processing latency while producing accurate and high-quality videos. Furthermore, we observe a significant portion of similar optical flow in time domain of continuous videos, which can be used to reduce the computation overhead. Thus, to utilize such temporal similarity of optical flow, the proposed IVP is upgraded to be capable of reusing previous computation results, which further improves energy efficiency of the whole system.

Förderung

  • National Natural Science Foundation of China
  • Strategic Priority Research Program of Chinese Academy of Sciences
  • Zhejiang Lab

Zitieren

APA

Gao, C., Wang, Y., Han, Y., Chen, W., & Zhang, L. (2023). IVP: An Intelligent Video Processing Architecture for Video Streaming. IEEE Transactions on Computers, 72(1), 264-277. https://doi.org/10.1109/tc.2022.3155950

Vancouver

Gao C, Wang Y, Han Y, Chen W, Zhang L. IVP: An Intelligent Video Processing Architecture for Video Streaming. IEEE Transactions on Computers. 2023;72(1):264-277. doi:10.1109/tc.2022.3155950

BibTeX
@article{Gao2023,
  author = {Gao, Chengsi and Wang, Ying and Han, Yinhe and Chen, Weiwei and Zhang, Lei},
  title = {IVP: An Intelligent Video Processing Architecture for Video Streaming},
  journal = {IEEE Transactions on Computers},
  year = {2023},
  volume = {72},
  number = {1},
  pages = {264--277},
  doi = {10.1109/tc.2022.3155950}
}
Kostenlos starten →