Structure-aware Video Style Transfer with Map Art
ACM Transactions on Multimedia Computing, Communications, and Applications · 31.10.2023 · 19 (3s) · 1-25
DOI: 10.1145/3572030 ↗Kurz gefasst
Fachartikel in der Zeitschrift ACM Transactions on Multimedia Computing, Communications, and Applications, online erschienen am 24.02.2023. Verfasst von Thi-Ngoc-Hanh Le und 2 weiteren Autor:innen. Die Arbeit wurde bisher 6-mal zitiert (Crossref) und nennt 52 Literaturangaben. Gefördert von: National Science and Technology Council.
Abstract (Originalsprache)
Changing the style of an image/video while preserving its content is a crucial criterion to access a new neural style transfer algorithm. However, it is very challenging to transfer a new map art style to a certain video in which “content” comprises a map background and animation objects. In this article, we present a novel comprehensive system that solves the problems in transferring map art style in such video. Our system takes as input an arbitrary video, a map image, and an off-the-shelf map art image. It then generates an artistic video without damaging the functionality of the map and the consistency in details. To solve this challenge, we propose a novel network, Map Art Video Network (MAViNet), the tailored objective functions, and a rich training set with rich animation contents and different map structures. We have evaluated our method on various challenging cases and many comparisons with those of the related works. Our method substantially outperforms state-of-the-art methods in terms of visual quality and meets the mentioned criteria in this research domain.
Förderung
- National Science and Technology Council
Zitieren
APA
Le, T., Chen, Y., & Lee, T. (2023). Structure-aware Video Style Transfer with Map Art. ACM Transactions on Multimedia Computing, Communications, and Applications, 19(3s), 1-25. https://doi.org/10.1145/3572030
Vancouver
Le T, Chen Y, Lee T. Structure-aware Video Style Transfer with Map Art. ACM Transactions on Multimedia Computing, Communications, and Applications. 2023;19(3s):1-25. doi:10.1145/3572030
BibTeX
@article{Le2023,
author = {Le, Thi-Ngoc-Hanh and Chen, Ya-Hsuan and Lee, Tong-Yee},
title = {Structure-aware Video Style Transfer with Map Art},
journal = {ACM Transactions on Multimedia Computing, Communications, and Applications},
year = {2023},
volume = {19},
number = {3s},
pages = {1--25},
doi = {10.1145/3572030}
}
EUVIMED