LayerDiffusion: High-Fidelity Layered Virtual Try-On via Semantic-Aware Diffusion
IEEE Transactions on Circuits and Systems for Video Technology · 2026-08 · 36 (8) · 11445-11458
DOI: 10.1109/tcsvt.2026.3679372 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Circuits and Systems for Video Technology, 2026-08. Verfasst von Fangjian Liao und 2 weiteren Autor:innen. Die Arbeit nennt 63 Literaturangaben. Gefördert von: Laboratory for Artificial Intelligence in Design, InnoHK Initiative of the Innovation and Technology Commission, Hong Kong Special Administrative Region Government.
Abstract (Originalsprache)
Image-based Virtual Try-On (VTON) aims to generate virtual try-on results by transferring input garment images onto target person images. Current algorithms have achieved high generalization and quality on public datasets including VITON and DressCode. However, current algorithms primarily process images at the pixel level while neglecting the semantic information of garments. Moreover, layered outerwear, as an essential aspect of try-on, has been largely overlooked. Layering increases the difficulty of precise garment control due to the need to consider inner garments. Furthermore, the task-specific nature of current methods prevents them from capturing layering characteristics in try-on. To address these limitations, we propose LayerDiffusion, a novel framework that enhances both generalization capability and semantic controllability for virtual try-on generation. Our approach makes three key contributions. First, we construct LayerDataset, a specialized dataset focusing on diverse outerwear garments with balanced gender representation and multi-view captures. Second, we integrate a pretrained image encoder to capture rich semantic garment information, combined with multi-conditional masking and adapter fine-tuning to enable flexible layering control. Third, we introduce a joint training strategy on both try-on and try-off tasks, which substantially improves model generalization by learning bidirectional garment-body correlations. Extensive experiments demonstrate that LayerDiffusion significantly outperforms existing state-of-the-art methods on public benchmarks (VITON-HD and DressCode) across multiple metrics including LPIPS, SSIM, FID, KID, and CLIP-based scores. Our method excels in both single-garment and layered try-on scenarios while naturally supporting try-off capabilities, offering superior semantic preservation and detail fidelity compared to existing approaches.
Förderung
- Laboratory for Artificial Intelligence in Design
- InnoHK Initiative of the Innovation and Technology Commission, Hong Kong Special Administrative Region Government
Zitieren
APA
Liao, F., Zou, X., & Wong, W. K. (2026). LayerDiffusion: High-Fidelity Layered Virtual Try-On via Semantic-Aware Diffusion. IEEE Transactions on Circuits and Systems for Video Technology, 36(8), 11445-11458. https://doi.org/10.1109/tcsvt.2026.3679372
Vancouver
Liao F, Zou X, Wong WK. LayerDiffusion: High-Fidelity Layered Virtual Try-On via Semantic-Aware Diffusion. IEEE Transactions on Circuits and Systems for Video Technology. 2026;36(8):11445-11458. doi:10.1109/tcsvt.2026.3679372
BibTeX
@article{Liao2026,
author = {Liao, Fangjian and Zou, Xingxing and Wong, Wai Keung},
title = {LayerDiffusion: High-Fidelity Layered Virtual Try-On via Semantic-Aware Diffusion},
journal = {IEEE Transactions on Circuits and Systems for Video Technology},
year = {2026},
volume = {36},
number = {8},
pages = {11445--11458},
doi = {10.1109/tcsvt.2026.3679372}
}
EUVIMED