Self-Supervised Multimodal 3-D Garment Reconstruction from a Single Consumer Image for Energy-Efficient Virtual Try-On Systems
ELCVIA Electronic Letters on Computer Vision and Image Analysis · 04.04.2026 · 25 (1) · 60-82
DOI: 10.5565/rev/elcvia.2276 ↗Kurz gefasst
Fachartikel in der Zeitschrift ELCVIA Electronic Letters on Computer Vision and Image Analysis, online erschienen am 04.04.2026. Verfasst von Roman Chekhmestruk und 1 weiteren Autor:innen. Die Arbeit nennt 99 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0).
Abstract (Originalsprache)
Accurate 3-D reconstruction of garments from a single consumer-grade image remains a critical barrier to truly immersive and resource-aware virtual try-on systems. We introduce a self-supervised, multimodal pipeline that fuses visual tokens extracted by a Vision Transformer with textual garment descriptors to synthesise high-fidelity cloth geometry and texture while operating within the stringent power envelope of mobile neural-processing units (NPUs). A hybrid latent-diffusion module generates pseudo-meshes that supervise a lightweight INT8-quantised Mesh-Autoencoder, thereby eliminating the dependence on large annotated 3-D-scan corpora. To compensate for limited real data we construct SyntheCloth-300K, a dataset blending CLO-3D captures with PhysX-driven synthetic variations, and use it for joint visual–textual training. On the DeepFashion3D benchmark our method reduces Chamfer-Distance by 18% and improves SSIM by 0.03 over DressCode-NeRF, while sustaining 21 FPS at 0.32mJvertex−1 on a Snapdragon 8 Gen 3 — tripling the energy efficiency of prior art. Qualitative results reveal robust reconstruction of fine pleats and fabric drape, even under severe self-occlusion. The proposed framework thus bridges computer vision, physically based graphics, and embedded optimisation, laying the groundwork for next-generation, on-device virtual fitting applications.
Zitieren
APA
Chekhmestruk, R., & Voitsekhovska, O. (2026). Self-Supervised Multimodal 3-D Garment Reconstruction from a Single Consumer Image for Energy-Efficient Virtual Try-On Systems. ELCVIA Electronic Letters on Computer Vision and Image Analysis, 25(1), 60-82. https://doi.org/10.5565/rev/elcvia.2276
Vancouver
Chekhmestruk R, Voitsekhovska O. Self-Supervised Multimodal 3-D Garment Reconstruction from a Single Consumer Image for Energy-Efficient Virtual Try-On Systems. ELCVIA Electronic Letters on Computer Vision and Image Analysis. 2026;25(1):60-82. doi:10.5565/rev/elcvia.2276
BibTeX
@article{Chekhmestruk2026,
author = {Chekhmestruk, Roman and Voitsekhovska, Olena},
title = {Self-Supervised Multimodal 3-D Garment Reconstruction from a Single Consumer Image for Energy-Efficient Virtual Try-On Systems},
journal = {ELCVIA Electronic Letters on Computer Vision and Image Analysis},
year = {2026},
volume = {25},
number = {1},
pages = {60--82},
doi = {10.5565/rev/elcvia.2276}
}
EUVIMED