PSDiffusion: Symmetry-Aware Diffusion for Harmonious Portrait Cast Shadow Removal
IEEE Transactions on Image Processing · 2026 · 35 · 11103-11117
DOI: 10.1109/tip.2026.3743769 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Image Processing, 2026. Verfasst von Jiangjian Yu und 5 weiteren Autor:innen. Die Arbeit nennt 45 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Key Research and Development Program for Technological Innovation Project of Hubei Province, Fundamental Research Funds for the Central Universities.
Abstract (Originalsprache)
Portrait cast shadow removal is a critical yet challenging task in computer vision and portrait editing. Current methods mainly rely on planar features, such as facial landmarks, to assist in cast shadow removal and often fail to fully exploit the geometric information of the face. Moreover, current methods often ignore the asymmetry of facial details and self-shadows caused by lighting orientations. In this work, we propose a Portrait Shadow Diffusion (PSDiffusion) framework to address these challenges. PSDiffusion combines diffusion models with facial geometry and illumination, achieving delicate balance between cast shadow removal and facial self-shadow preserving through illumination consistency constraint and symmetry-aware attention mechanism. Specifically, we first design a Face Symmetry Flip Module to generate a flipped facial image, which presents the potentially cast shadow-free features for subsequent shadow removal. Then, we introduce a pre-trained Feature Extraction Diffusion Module to extract cast shadow free features from the flipped facial image. Finally, we adaptively fuse the extracted cast shadow free features with the features from the input image into the Symmetry-aware Diffusion Module, and generate the final cast shadow removal result with preserved self-shadows. Furthermore, we construct a large-scale portrait shadow dataset (LPSD) with diverse real-world scenarios of portrait shadows. Comprehensive experiments conducted on existing open-source facial datasets and web-collected images demonstrate that our method surpasses state-of-the-art techniques in cast shadow removal.
Förderung
- National Natural Science Foundation of China
- Key Research and Development Program for Technological Innovation Project of Hubei Province
- Fundamental Research Funds for the Central Universities
Zitieren
APA
Yu, J., Zhang, L., Zhang, Q., Hu, S., Liang, C., & Xiao, C. (2026). PSDiffusion: Symmetry-Aware Diffusion for Harmonious Portrait Cast Shadow Removal. IEEE Transactions on Image Processing, 35, 11103-11117. https://doi.org/10.1109/tip.2026.3743769
Vancouver
Yu J, Zhang L, Zhang Q, Hu S, Liang C, Xiao C. PSDiffusion: Symmetry-Aware Diffusion for Harmonious Portrait Cast Shadow Removal. IEEE Transactions on Image Processing. 2026;35:11103-11117. doi:10.1109/tip.2026.3743769
BibTeX
@article{Yu2026,
author = {Yu, Jiangjian and Zhang, Ling and Zhang, Qing and Hu, ShengHong and Liang, Chao and Xiao, Chunxia},
title = {PSDiffusion: Symmetry-Aware Diffusion for Harmonious Portrait Cast Shadow Removal},
journal = {IEEE Transactions on Image Processing},
year = {2026},
volume = {35},
pages = {11103--11117},
doi = {10.1109/tip.2026.3743769}
}
EUVIMED