Chinese Ancient Paintings Inpainting Based on Edge Guidance and Multi-Scale Residual Blocks
Electronics · 26.03.2024 · 13 (7) · 1212
DOI: 10.3390/electronics13071212 ↗Kurz gefasst
Fachartikel in der Zeitschrift Electronics, online erschienen am 26.03.2024. Verfasst von Zengguo Sun und 2 weiteren Autor:innen. Die Arbeit wurde bisher 11-mal zitiert (Crossref) und nennt 55 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Key Research and Development Program of China, National Natural Science Foundation of China, Shaanxi Key Science and Technology Innovation Team Project.
Abstract (Originalsprache)
Chinese paintings have great cultural and artistic significance and are known for their delicate lines and rich textures. Unfortunately, many ancient paintings have been damaged due to historical and natural factors. The deep learning methods that are successful in restoring natural images cannot be applied to the inpainting of ancient paintings. Thus, we propose a model named Edge-MSGAN for inpainting Chinese ancient paintings based on edge guidance and multi-scale residual blocks. The Edge-MSGAN utilizes edge images to direct the completion network in order to generate entire ancient paintings. It then applies the multi-branch color correction network to adjust the colors. Furthermore, the model uses multi-scale channel attention residual blocks to learn the semantic features of ancient paintings at various levels. At the same time, by using polarized self-attention, the model can improve its concentration on significant structures, edges, and details, which leads to paintings that possess clear lines and intricate details. Finally, we have created a dataset for ancient paintings inpainting, and have conducted experiments in order to evaluate the model’s performance. After comparing the proposed model with state-of-the-art models from qualitative and quantitative aspects, it was found that our model is better at inpainting the texture, edge, and color of ancient paintings. Therefore, our model achieved maximum PSNR and SSIM values of 34.7127 and 0.9280 respectively, and minimum MSE and LPIPS values of 0.0006 and 0.0495, respectively.
Förderung
- National Key Research and Development Program of China
- National Natural Science Foundation of China
- Shaanxi Key Science and Technology Innovation Team Project
- Xi’an Science and Technology Plan Project
- Fundamental Research Funds for the Central Universities
Zitieren
APA
Sun, Z., Lei, Y., & Wu, X. (2024). Chinese Ancient Paintings Inpainting Based on Edge Guidance and Multi-Scale Residual Blocks. Electronics, 13(7), 1212. https://doi.org/10.3390/electronics13071212
Vancouver
Sun Z, Lei Y, Wu X. Chinese Ancient Paintings Inpainting Based on Edge Guidance and Multi-Scale Residual Blocks. Electronics. 2024;13(7):1212. doi:10.3390/electronics13071212
BibTeX
@article{Sun2024,
author = {Sun, Zengguo and Lei, Yanyan and Wu, Xiaojun},
title = {Chinese Ancient Paintings Inpainting Based on Edge Guidance and Multi-Scale Residual Blocks},
journal = {Electronics},
year = {2024},
volume = {13},
number = {7},
pages = {1212},
doi = {10.3390/electronics13071212}
}
EUVIMED