EUVIMEDEUVIMED entdecken
Crossref

MANSY: Generalizing Neural Adaptive Immersive Video Streaming With Ensemble and Representation Learning

Duo Wu, Panlong Wu, Miao Zhang, Fangxin Wang

IEEE Transactions on Mobile Computing · 2025-03 · 24 (3) · 1654-1668

DOI: 10.1109/tmc.2024.3487175 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Mobile Computing, 2025-03. Verfasst von Duo Wu und 3 weiteren Autor:innen. Die Arbeit wurde bisher 19-mal zitiert (Crossref) und nennt 46 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Basic Research Project, Shenzhen Science and Technology Program.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The popularity of immersive videos has prompted extensive research into neural adaptive tile-based streaming to optimize video transmission over networks with limited bandwidth. However, the diversity of users’ viewing patterns and Quality of Experience (QoE) preferences has not been fully addressed yet by existing neural adaptive approaches for viewport prediction and bitrate selection. Their performance can significantly deteriorate when users’ actual viewing patterns and QoE preferences differ considerably from those observed during the training phase, resulting in poor generalization. In this paper, we propose MANSY, a novel streaming system that embraces user diversity to improve generalization. Specifically, to accommodate users’ diverse viewing patterns, we design a Transformer-based viewport prediction model with an efficient multi-viewport trajectory input output architecture based on implicit ensemble learning. Besides, we for the first time combine the advanced representation learning and deep reinforcement learning to train the bitrate selection model to maximize diverse QoE objectives, enabling the model to generalize across users with diverse preferences. Extensive experiments demonstrate that MANSY outperforms state-of-the-art approaches in viewport prediction accuracy and QoE improvement on both trained and unseen viewing patterns and QoE preferences, achieving better generalization.

Förderung

  • National Natural Science Foundation of China
  • Basic Research Project
  • Shenzhen Science and Technology Program
  • Shenzhen Outstanding Talents Training Fund
  • Guangdong Research Projects
  • Young Elite Scientists Sponsorship Program of CAST
  • Guangdong Provincial Key Laboratory of Future Networks of Intelligence
  • Shenzhen Key Laboratory of Big Data and Artificial Intelligence

Zitieren

APA

Wu, D., Wu, P., Zhang, M., & Wang, F. (2025). MANSY: Generalizing Neural Adaptive Immersive Video Streaming With Ensemble and Representation Learning. IEEE Transactions on Mobile Computing, 24(3), 1654-1668. https://doi.org/10.1109/tmc.2024.3487175

Vancouver

Wu D, Wu P, Zhang M, Wang F. MANSY: Generalizing Neural Adaptive Immersive Video Streaming With Ensemble and Representation Learning. IEEE Transactions on Mobile Computing. 2025;24(3):1654-1668. doi:10.1109/tmc.2024.3487175

BibTeX
@article{Wu2025,
  author = {Wu, Duo and Wu, Panlong and Zhang, Miao and Wang, Fangxin},
  title = {MANSY: Generalizing Neural Adaptive Immersive Video Streaming With Ensemble and Representation Learning},
  journal = {IEEE Transactions on Mobile Computing},
  year = {2025},
  volume = {24},
  number = {3},
  pages = {1654--1668},
  doi = {10.1109/tmc.2024.3487175}
}
Kostenlos starten →