Representation Learning of Problem-Solving Behavior in Virtual Reality Manufacturing Environment Using Long Short-Term Memory Networks
Journal of Mechanical Design · 01.11.2026 · 148 (11)
DOI: 10.1115/1.4071655 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Mechanical Design, online erschienen am 27.04.2026. Verfasst von Rui Zhu und 4 weiteren Autor:innen. Die Arbeit nennt 56 Literaturangaben. Gefördert von: National Science Foundation.
Abstract (Originalsprache)
The number of manufacturing jobs in the US has been consistently increasing, driven by a rapidly evolving industrial landscape and the implementation of a new strategic plan. At the same time, concerns have emerged about the problem-solving abilities of engineering students, who represent the future workforce. This highlights the need for systematic evaluation and deeper insight into how these students approach problem-solving. In this article, we introduce a virtual reality (VR)-based manufacturing environment combined with a data-driven analytical workflow to evaluate engineering students’ problem-solving performance. Within the VR system, students complete assembly tasks to build car toys that meet specific design criteria. During the process, we capture real-time eye-tracking data, reflecting the spatial and temporal dynamics of their visual attention and assembly actions. We extract latent features from this data via a long short-term memory-based supervised representation learning for problem-solving performance evaluation. Our approach outperforms the traditional performance metrics-based evaluation by capturing the nonlinear dynamics of the in situ problem-solving process. Experimental results, including benchmarking against alternative architectures and ablation analyses, show that the learned feature representations yield the clearest distinctions in categorizing students' problem-solving performance among the evaluated methods when integrating full behavioral input. The proposed evaluation framework holds broader potential for improving problem-solving assessments across various manufacturing systems and workforce training programs.
Förderung
- National Science Foundation
Zitieren
APA
Zhu, R., Aqlan, F., Zhao, R., Yang, H., & Li, Y. (2026). Representation Learning of Problem-Solving Behavior in Virtual Reality Manufacturing Environment Using Long Short-Term Memory Networks. Journal of Mechanical Design, 148(11). https://doi.org/10.1115/1.4071655
Vancouver
Zhu R, Aqlan F, Zhao R, Yang H, Li Y. Representation Learning of Problem-Solving Behavior in Virtual Reality Manufacturing Environment Using Long Short-Term Memory Networks. Journal of Mechanical Design. 2026;148(11). doi:10.1115/1.4071655
BibTeX
@article{Zhu2026,
author = {Zhu, Rui and Aqlan, Faisal and Zhao, Richard and Yang, Hui and Li, Yifu},
title = {Representation Learning of Problem-Solving Behavior in Virtual Reality Manufacturing Environment Using Long Short-Term Memory Networks},
journal = {Journal of Mechanical Design},
year = {2026},
volume = {148},
number = {11},
doi = {10.1115/1.4071655}
}
EUVIMED