Ancient Painting Inpainting with Regional Attention-Style Transfer and Global Context Perception
Applied Sciences · 28.09.2024 · 14 (19) · 8777
DOI: 10.3390/app14198777 ↗Kurz gefasst
Fachartikel in der Zeitschrift Applied Sciences, online erschienen am 28.09.2024. Verfasst von Xiaotong Liu und 2 weiteren Autor:innen. Die Arbeit wurde bisher 7-mal zitiert (Crossref) und nennt 33 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Fundamental Research Funds for the Central Universities.
Abstract (Originalsprache)
Ancient paintings, as a vital component of cultural heritage, encapsulate a profound depth of cultural significance. Over time, they often suffer from different degradation conditions, leading to damage. Existing ancient painting inpainting methods struggle with semantic discontinuities, blurred textures, and details in missing areas. To address these issues, this paper proposes a generative adversarial network (GAN)-based ancient painting inpainting method named RG-GAN. Firstly, to address the inconsistency between the styles of missing and non-missing areas, this paper proposes a Regional Attention-Style Transfer Module (RASTM) to achieve complex style transfer while maintaining the authenticity of the content. Meanwhile, a multi-scale fusion generator (MFG) is proposed to use the multi-scale residual downsampling module to reduce the size of the feature map and effectively extract and integrate the features of different scales. Secondly, a multi-scale fusion mechanism leverages the Multi-scale Cross-layer Perception Module (MCPM) to enhance feature representation of filled areas to solve the semantic incoherence of the missing region of the image. Finally, the Global Context Perception Discriminator (GCPD) is proposed for the deficiencies in capturing detailed information, which enhances the information interaction across dimensions and improves the discriminator’s ability to identify specific spatial areas and extract critical detail information. Experiments on the ancient painting and ancient Huaniao++ datasets demonstrate that our method achieves the highest PSNR values of 34.62 and 23.46 and the lowest LPIPS values of 0.0507 and 0.0938, respectively.
Förderung
- Fundamental Research Funds for the Central Universities
Zitieren
APA
Liu, X., Wan, J., & Wang, N. (2024). Ancient Painting Inpainting with Regional Attention-Style Transfer and Global Context Perception. Applied Sciences, 14(19), 8777. https://doi.org/10.3390/app14198777
Vancouver
Liu X, Wan J, Wang N. Ancient Painting Inpainting with Regional Attention-Style Transfer and Global Context Perception. Applied Sciences. 2024;14(19):8777. doi:10.3390/app14198777
BibTeX
@article{Liu2024,
author = {Liu, Xiaotong and Wan, Jin and Wang, Nan},
title = {Ancient Painting Inpainting with Regional Attention-Style Transfer and Global Context Perception},
journal = {Applied Sciences},
year = {2024},
volume = {14},
number = {19},
pages = {8777},
doi = {10.3390/app14198777}
}
EUVIMED