EUVIMEDSkopri EUVIMED
Open access · CC BY 4.0

Chinese Ancient Paintings Inpainting Based on Edge Guidance and Multi-Scale Residual Blocks

Zengguo Sun, Yanyan Lei, Xiaojun Wu

Electronics · 2024-03-26 · 13 (7) · 1212

DOI: 10.3390/electronics13071212 ↗

At a glance

Journal article in Electronics, published online on 2024-03-26. Written by Zengguo Sun and 2 co-authors. Cited 11 times so far (Crossref); 55 references. The full text is freely available (open access, CC BY 4.0). Funded by: National Key Research and Development Program of China, National Natural Science Foundation of China, Shaanxi Key Science and Technology Innovation Team Project.

AstrattDettalji biblijografiċiCiteRelated studies

Abstract (original language)

Chinese paintings have great cultural and artistic significance and are known for their delicate lines and rich textures. Unfortunately, many ancient paintings have been damaged due to historical and natural factors. The deep learning methods that are successful in restoring natural images cannot be applied to the inpainting of ancient paintings. Thus, we propose a model named Edge-MSGAN for inpainting Chinese ancient paintings based on edge guidance and multi-scale residual blocks. The Edge-MSGAN utilizes edge images to direct the completion network in order to generate entire ancient paintings. It then applies the multi-branch color correction network to adjust the colors. Furthermore, the model uses multi-scale channel attention residual blocks to learn the semantic features of ancient paintings at various levels. At the same time, by using polarized self-attention, the model can improve its concentration on significant structures, edges, and details, which leads to paintings that possess clear lines and intricate details. Finally, we have created a dataset for ancient paintings inpainting, and have conducted experiments in order to evaluate the model’s performance. After comparing the proposed model with state-of-the-art models from qualitative and quantitative aspects, it was found that our model is better at inpainting the texture, edge, and color of ancient paintings. Therefore, our model achieved maximum PSNR and SSIM values of 34.7127 and 0.9280 respectively, and minimum MSE and LPIPS values of 0.0006 and 0.0495, respectively.

Funding

  • National Key Research and Development Program of China
  • National Natural Science Foundation of China
  • Shaanxi Key Science and Technology Innovation Team Project
  • Xi’an Science and Technology Plan Project
  • Fundamental Research Funds for the Central Universities

Cite

APA

Sun, Z., Lei, Y., & Wu, X. (2024). Chinese Ancient Paintings Inpainting Based on Edge Guidance and Multi-Scale Residual Blocks. Electronics, 13(7), 1212. https://doi.org/10.3390/electronics13071212

Vancouver

Sun Z, Lei Y, Wu X. Chinese Ancient Paintings Inpainting Based on Edge Guidance and Multi-Scale Residual Blocks. Electronics. 2024;13(7):1212. doi:10.3390/electronics13071212

BibTeX
@article{Sun2024,
  author = {Sun, Zengguo and Lei, Yanyan and Wu, Xiaojun},
  title = {Chinese Ancient Paintings Inpainting Based on Edge Guidance and Multi-Scale Residual Blocks},
  journal = {Electronics},
  year = {2024},
  volume = {13},
  number = {7},
  pages = {1212},
  doi = {10.3390/electronics13071212}
}
Start for free →