Audio-Driven Facial Animation with Deep Learning: A Survey
Information · 28.10.2024 · 15 (11) · 675
DOI: 10.3390/info15110675 ↗Kurz gefasst
Fachartikel in der Zeitschrift Information, online erschienen am 28.10.2024. Verfasst von Diqiong Jiang und 5 weiteren Autor:innen. Die Arbeit wurde bisher 17-mal zitiert (Crossref) und nennt 170 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: European Union’s Horizon 2020 research and innovation programme under the Marie Skłodowska-Curie.
Abstract (Originalsprache)
Audio-driven facial animation is a rapidly evolving field that aims to generate realistic facial expressions and lip movements synchronized with a given audio input. This survey provides a comprehensive review of deep learning techniques applied to audio-driven facial animation, with a focus on both audio-driven facial image animation and audio-driven facial mesh animation. These approaches employ deep learning to map audio inputs directly onto 3D facial meshes or 2D images, enabling the creation of highly realistic and synchronized animations. This survey also explores evaluation metrics, available datasets, and the challenges that remain, such as disentangling lip synchronization and emotions, generalization across speakers, and dataset limitations. Lastly, we discuss future directions, including multi-modal integration, personalized models, and facial attribute modification in animations, all of which are critical for the continued development and application of this technology.
Förderung
- European Union’s Horizon 2020 research and innovation programme under the Marie Skłodowska-Curie
Zitieren
APA
Jiang, D., Chang, J., You, L., Bian, S., Kosk, R., & Maguire, G. (2024). Audio-Driven Facial Animation with Deep Learning: A Survey. Information, 15(11), 675. https://doi.org/10.3390/info15110675
Vancouver
Jiang D, Chang J, You L, Bian S, Kosk R, Maguire G. Audio-Driven Facial Animation with Deep Learning: A Survey. Information. 2024;15(11):675. doi:10.3390/info15110675
BibTeX
@article{Jiang2024,
author = {Jiang, Diqiong and Chang, Jian and You, Lihua and Bian, Shaojun and Kosk, Robert and Maguire, Greg},
title = {Audio-Driven Facial Animation with Deep Learning: A Survey},
journal = {Information},
year = {2024},
volume = {15},
number = {11},
pages = {675},
doi = {10.3390/info15110675}
}
EUVIMED