Using Decoupled Features for Photorealistic Style Transfer
SIAM Journal on Imaging Sciences · 30.09.2023 · 16 (3) · 1687-1726
DOI: 10.1137/22m1512491 ↗Kurz gefasst
Fachartikel in der Zeitschrift SIAM Journal on Imaging Sciences, online erschienen am 29.08.2023. Verfasst von Trevor Canham und 3 weiteren Autor:innen. Die Arbeit wurde bisher 3-mal zitiert (Crossref) und nennt 49 Literaturangaben. Gefördert von: Spanish Government, Horizon 2020 Framework Programme.
Abstract (Originalsprache)
In this work we propose a photorealistic style transfer method for image and video that is based on vision science principles and on a recent mathematical formulation for the deterministic decoupling of sample statistics. The novel aspects of our approach include matching decoupled moments of higher order than in common style transfer approaches, and matching a descriptor of the power spectrum so as to characterize and transfer diffusion effects between source and target, which is something that has not been considered before in the literature. The results are of high visual quality, without spatio-temporal artifacts, and validation tests in the form of observer preference experiments show that our method compares very well with the state of the art. The computational complexity of the algorithm is low, and we propose a numerical implementation that is amenable for real-time video application. Finally, another contribution of our work is to point out that current deep learning approaches for photorealistic style transfer don’t really achieve photorealistic quality outside of limited examples, because the results too often show unacceptable visual artifacts.
Förderung
- Spanish Government
- Horizon 2020 Framework Programme
Zitieren
APA
Canham, T., Fernández, A. M., Bertalmío, M., & Portilla, J. (2023). Using Decoupled Features for Photorealistic Style Transfer. SIAM Journal on Imaging Sciences, 16(3), 1687-1726. https://doi.org/10.1137/22m1512491
Vancouver
Canham T, Fernández AM, Bertalmío M, Portilla J. Using Decoupled Features for Photorealistic Style Transfer. SIAM Journal on Imaging Sciences. 2023;16(3):1687-1726. doi:10.1137/22m1512491
BibTeX
@article{Canham2023,
author = {Canham, Trevor and Fernández, Adrián Martín and Bertalmío, Marcelo and Portilla, Javier},
title = {Using Decoupled Features for Photorealistic Style Transfer},
journal = {SIAM Journal on Imaging Sciences},
year = {2023},
volume = {16},
number = {3},
pages = {1687--1726},
doi = {10.1137/22m1512491}
}
EUVIMED