G2LP-Net: Global to Local Progressive Video Inpainting Network
IEEE Transactions on Circuits and Systems for Video Technology · 2023-03 · 33 (3) · 1082-1092
DOI: 10.1109/tcsvt.2022.3209548 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Circuits and Systems for Video Technology, 2023-03. Verfasst von Zhong Ji und 4 weiteren Autor:innen. Die Arbeit wurde bisher 16-mal zitiert (Crossref) und nennt 47 Literaturangaben. Gefördert von: National Natural Science Foundation of China.
Abstract (Originalsprache)
The self-attention based video inpainting methods have achieved promising progress by establishing long-range correlation over the whole video. However, existing methods generally relied on the global self-attention that directly searches missing contents among all reference frames but lacks accurate matching and effective organization on contents, which often blurs the result owing to the loss of local textures. In this paper, we propose a Global-to-Local Progressive Inpainting Network (G2LP-Net) consisting of the following innovative ideas. First, we present a global to local self-attention mechanism by incorporating local self-attention into global self-attention to improve searching efficiency and accuracy, where the self-attention is implemented in multi-scale regions to fully exploit local redundancy for the texture recovery. Second, we propose a progressive video inpainting (PVI) method to organize the generated contents, which completes the target video frames from periphery to core to ensure reliable contents serve first. Last, we develop a window-sliding method for sampling reference frames to obtain rich available information for inpainting. In addition, we release a wire-removal video (WRV) dataset that consists of 150 video clips masked by wires to evaluate the video inpainting on irregularly slender regions. Both quantitative and qualitative experiments on benchmark datasets, DAVIS, YouTube-VOS and our WRV dataset have demonstrated the superiority of our proposed G2LP-Net method.
Förderung
- National Natural Science Foundation of China
Zitieren
APA
Ji, Z., Hou, J., Su, Y., Pang, Y., & Li, X. (2023). G2LP-Net: Global to Local Progressive Video Inpainting Network. IEEE Transactions on Circuits and Systems for Video Technology, 33(3), 1082-1092. https://doi.org/10.1109/tcsvt.2022.3209548
Vancouver
Ji Z, Hou J, Su Y, Pang Y, Li X. G2LP-Net: Global to Local Progressive Video Inpainting Network. IEEE Transactions on Circuits and Systems for Video Technology. 2023;33(3):1082-1092. doi:10.1109/tcsvt.2022.3209548
BibTeX
@article{Ji2023,
author = {Ji, Zhong and Hou, Jiacheng and Su, Yimu and Pang, Yanwei and Li, Xuelong},
title = {G2LP-Net: Global to Local Progressive Video Inpainting Network},
journal = {IEEE Transactions on Circuits and Systems for Video Technology},
year = {2023},
volume = {33},
number = {3},
pages = {1082--1092},
doi = {10.1109/tcsvt.2022.3209548}
}
EUVIMED