Virtual Footwear Try-On in Augmented Reality Using Deep Learning Models
Journal of Computing and Information Science in Engineering · 01.03.2024 · 24 (3)
DOI: 10.1115/1.4062596 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Computing and Information Science in Engineering, online erschienen am 09.10.2023. Verfasst von Ting Chou und 2 weiteren Autor:innen. Die Arbeit wurde bisher 6-mal zitiert (Crossref) und nennt 27 Literaturangaben. Gefördert von: National Science Council.
Abstract (Originalsprache)
Customization is an increasing trend in fashion product industry to reflect individual lifestyles. Previous studies have examined the idea of virtual footwear try-on in augmented reality (AR) using a depth camera. However, the depth camera restricts the deployment of this technology in practice. This research proposes to estimate the six degrees-of-freedom pose of a human foot from a color image using deep learning models to solve the problem. We construct a training dataset consisting of synthetic and real foot images that are automatically annotated. Three convolutional neural network models (deep object pose estimation (DOPE), DOPE2, and You Only Look Once (YOLO)-6D) are trained with the dataset to predict the foot pose in real-time. The model performances are evaluated using metrics for accuracy, computational efficiency, and training time. A prototyping system implementing the best model demonstrates the feasibility of virtual footwear try-on using a red–green–blue camera. Test results also indicate the necessity of real training data to bridge the reality gap in estimating the human foot pose.
Förderung
- National Science Council
Zitieren
APA
Chou, T., Chu, C., & Liu, S. (2024). Virtual Footwear Try-On in Augmented Reality Using Deep Learning Models. Journal of Computing and Information Science in Engineering, 24(3). https://doi.org/10.1115/1.4062596
Vancouver
Chou T, Chu C, Liu S. Virtual Footwear Try-On in Augmented Reality Using Deep Learning Models. Journal of Computing and Information Science in Engineering. 2024;24(3). doi:10.1115/1.4062596
BibTeX
@article{Chou2024,
author = {Chou, Ting and Chu, Chih-Hsing and Liu, Shengjun},
title = {Virtual Footwear Try-On in Augmented Reality Using Deep Learning Models},
journal = {Journal of Computing and Information Science in Engineering},
year = {2024},
volume = {24},
number = {3},
doi = {10.1115/1.4062596}
}
EUVIMED