MEScan360: A Memory-Enhanced Scanpath Prediction Model for Omnidirectional Images
ACM Transactions on Multimedia Computing, Communications, and Applications · 31.08.2026 · 22 (8) · 1-22
DOI: 10.1145/3820041 ↗Kurz gefasst
Fachartikel in der Zeitschrift ACM Transactions on Multimedia Computing, Communications, and Applications, online erschienen am 22.07.2026. Verfasst von Yuchen Zhang und 6 weiteren Autor:innen. Die Arbeit nennt 80 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China, China Postdoctoral Science Foundation.
Abstract (Originalsprache)
Scanpath prediction for omnidirectional images aims to capture the dynamic viewing behavior of humans while freely exploring visual scenes. The complex gaze behavior along with the inevitable projection distortion, however, present significant challenges in the scanpath prediction task for omnidirectional scenes. Most existing methods neither capture the long-term dependencies across visual states nor fully incorporate historical memory information, leading to suboptimal performance. To this end, we propose MEScan360, a novel memory-enhanced scanpath prediction model for omnidirectional images, which effectively preserves historical information in the working-memory space and builds long-range temporal dependencies across visual states. Specifically, inspired by the crucial role of historical context and scene semantics in guiding visual attention, we propose a long-term memory storage unit and a memory interaction module. These two components establish a more explicit link between past visual information and current visual inputs, thereby significantly enhancing the performance of scanpath prediction. Furthermore, a robust feature extraction module is designed to extract rotation-invariant semantic features. Extensive experiments on benchmark datasets demonstrate that MEScan360 achieves competitive performance in both accuracy and efficiency. Notably, our MEScan360 exhibits strong generalization ability across two computer vision tasks: saliency prediction and virtual scene design assistance, providing valuable insights for other vision-related applications.
Förderung
- National Natural Science Foundation of China
- China Postdoctoral Science Foundation
Zitieren
APA
Zhang, Y., Zhu, D., Zhang, K., Zhu, K., Zhang, N., Min, X., & Zhai, G. (2026). MEScan360: A Memory-Enhanced Scanpath Prediction Model for Omnidirectional Images. ACM Transactions on Multimedia Computing, Communications, and Applications, 22(8), 1-22. https://doi.org/10.1145/3820041
Vancouver
Zhang Y, Zhu D, Zhang K, Zhu K, Zhang N, Min X, et al. MEScan360: A Memory-Enhanced Scanpath Prediction Model for Omnidirectional Images. ACM Transactions on Multimedia Computing, Communications, and Applications. 2026;22(8):1-22. doi:10.1145/3820041
BibTeX
@article{Zhang2026,
author = {Zhang, Yuchen and Zhu, Dandan and Zhang, Kaiwei and Zhu, Kun and Zhang, Nana and Min, Xiongkuo and Zhai, Guangtao},
title = {MEScan360: A Memory-Enhanced Scanpath Prediction Model for Omnidirectional Images},
journal = {ACM Transactions on Multimedia Computing, Communications, and Applications},
year = {2026},
volume = {22},
number = {8},
pages = {1--22},
doi = {10.1145/3820041}
}
EUVIMED