EUVIMEDEUVIMED entdecken
Crossref

Optimizing Mobile-Friendly Viewport Prediction for Live 360-Degree Video Streaming

Lei Zhang, Peng Chen, Cong Zhang, Cheng Pan, Tao Long, Weizhen Xu, Laizhong Cui, Jiangchuan Liu

IEEE Transactions on Mobile Computing · 2025-10 · 24 (10) · 10441-10455

DOI: 10.1109/tmc.2025.3571186 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Mobile Computing, 2025-10. Verfasst von Lei Zhang und 7 weiteren Autor:innen. Die Arbeit wurde bisher 11-mal zitiert (Crossref) und nennt 49 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Shenzhen Science and Technology Program, Basic and Applied Basic Research Foundation of Guangdong Province.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Viewport prediction is the crucial task for adaptive 360-degree video streaming, as the bitrate control algorithms usually require the knowledge of the user's viewing portions of the frames. Various methods are studied and adopted for viewport prediction from less accurate statistic tools to highly calibrated deep neural networks. Conventionally, it is difficult to implement sophisticated deep learning methods on mobile devices, which have limited computation capability. In this work, we propose an advanced learning-based viewport prediction approach and carefully design it to minimize transmission and computation overhead for mobile terminals. To improve viewport prediction accuracy, we utilize both spatial information through a saliency prediction model and temporal information through a modified LSTM model. Different computations introduced by the neural network models are distributed across the network to keep the computation light on mobile devices. To better adapt to the content dynamics in live streaming, we employ the model-agnostic meta-learning (MAML) method for video saliency prediction. The learned saliency prediction model with optimized initialization via offline meta-training can be fast fine-tuned online using a few samples. We further discuss how to integrate this mobile-friendly viewport prediction (MFVP) approach into a typical 360-degree video live streaming system by formulating and solving the bitrate adaptation problem. Extensive experiment results demonstrate that our approach achieves real-time prediction for live video streaming and surpasses existing methods in prediction accuracy on mobile terminals, which, together with our bitrate adaptation algorithm, significantly improves the streaming QoE from various aspects. Compared to baseline methods, MFVP achieves a 4.7–28.7% improvement in accuracy and demonstrates faster adaptability to dynamic content changes, enabling rapid fine-tuning and adjustment. When integrated into a streaming system and paired with our adaptive bitrate allocation algorithm, MFVP enhances overall video quality by 5.6–12.9% and reduces quality fluctuations by 33.3–50.9%.

Förderung

  • National Natural Science Foundation of China
  • Shenzhen Science and Technology Program
  • Basic and Applied Basic Research Foundation of Guangdong Province
  • Research Team Cultivation Program of Shenzhen University

Zitieren

APA

Zhang, L., Chen, P., Zhang, C., Pan, C., Long, T., Xu, W., Cui, L., & Liu, J. (2025). Optimizing Mobile-Friendly Viewport Prediction for Live 360-Degree Video Streaming. IEEE Transactions on Mobile Computing, 24(10), 10441-10455. https://doi.org/10.1109/tmc.2025.3571186

Vancouver

Zhang L, Chen P, Zhang C, Pan C, Long T, Xu W, et al. Optimizing Mobile-Friendly Viewport Prediction for Live 360-Degree Video Streaming. IEEE Transactions on Mobile Computing. 2025;24(10):10441-10455. doi:10.1109/tmc.2025.3571186

BibTeX
@article{Zhang2025,
  author = {Zhang, Lei and Chen, Peng and Zhang, Cong and Pan, Cheng and Long, Tao and Xu, Weizhen and Cui, Laizhong and Liu, Jiangchuan},
  title = {Optimizing Mobile-Friendly Viewport Prediction for Live 360-Degree Video Streaming},
  journal = {IEEE Transactions on Mobile Computing},
  year = {2025},
  volume = {24},
  number = {10},
  pages = {10441--10455},
  doi = {10.1109/tmc.2025.3571186}
}
Kostenlos starten →