A Real‐Time VIMS Prediction Model Based on Short Long‐Term Visual Motion Features
Computer Animation and Virtual Worlds · 2026-05 · 37 (3)
DOI: 10.1002/cav.70154 ↗Kurz gefasst
Fachartikel in der Zeitschrift Computer Animation and Virtual Worlds, online erschienen am 05.06.2026. Verfasst von Wei Quan und 4 weiteren Autor:innen. Die Arbeit nennt 64 Literaturangaben. Gefördert von: Natural Science Foundation of Jilin Province.
Abstract (Originalsprache)
Visually induced motion sickness (VIMS) is one of the major obstacles to the broader adoption of virtual reality (VR) technology. As visual‐vestibular conflict is considered a major factor contributing to VIMS, real‐time prediction from visual cues remains crucial for timely intervention and for improving user experience. In this paper, we present a real‐time VIMS prediction model that utilizes a hybrid architecture of a 3D Convolutional Neural Network and a Long Short‐Term Memory network to capture both short and long‐term features. We used low‐resolution frames and replaced optical flow with frame difference maps and lateral/vertical displacement components to reduce data complexity and accelerate model inference. Experimental results on two datasets demonstrate that our model outperforms existing vision‐based approaches, such as VR‐SP and VR‐SA, with an RMSE of 3.77 and a PLCC of 0.935. Importantly, the average processing time for each 108‐frame video is less than 0.83 s. In addition, the method's real‐time VIMS prediction capability has been verified in a Unity3D‐based VR environment, with an end‐to‐end latency of 192 ms. These results highlight the model's advantages in terms of both efficiency and accuracy, making it a promising solution for VIMS‐aware VR applications.
Förderung
- Natural Science Foundation of Jilin Province
Zitieren
APA
Quan, W., Yin, Z., Yang, Y., Zhang, H., & Han, C. (2026). A Real‐Time VIMS Prediction Model Based on Short Long‐Term Visual Motion Features. Computer Animation and Virtual Worlds, 37(3). https://doi.org/10.1002/cav.70154
Vancouver
Quan W, Yin Z, Yang Y, Zhang H, Han C. A Real‐Time VIMS Prediction Model Based on Short Long‐Term Visual Motion Features. Computer Animation and Virtual Worlds. 2026;37(3). doi:10.1002/cav.70154
BibTeX
@article{Quan2026,
author = {Quan, Wei and Yin, Zekai and Yang, Yang and Zhang, Hui and Han, Cheng},
title = {A Real‐Time VIMS Prediction Model Based on Short Long‐Term Visual Motion Features},
journal = {Computer Animation and Virtual Worlds},
year = {2026},
volume = {37},
number = {3},
doi = {10.1002/cav.70154}
}
EUVIMED