EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Audio-Driven Facial Animation with Deep Learning: A Survey

Diqiong Jiang, Jian Chang, Lihua You, Shaojun Bian, Robert Kosk, Greg Maguire

Information · 28.10.2024 · 15 (11) · 675

DOI: 10.3390/info15110675 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Information, online erschienen am 28.10.2024. Verfasst von Diqiong Jiang und 5 weiteren Autor:innen. Die Arbeit wurde bisher 17-mal zitiert (Crossref) und nennt 170 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: European Union’s Horizon 2020 research and innovation programme under the Marie Skłodowska-Curie.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Audio-driven facial animation is a rapidly evolving field that aims to generate realistic facial expressions and lip movements synchronized with a given audio input. This survey provides a comprehensive review of deep learning techniques applied to audio-driven facial animation, with a focus on both audio-driven facial image animation and audio-driven facial mesh animation. These approaches employ deep learning to map audio inputs directly onto 3D facial meshes or 2D images, enabling the creation of highly realistic and synchronized animations. This survey also explores evaluation metrics, available datasets, and the challenges that remain, such as disentangling lip synchronization and emotions, generalization across speakers, and dataset limitations. Lastly, we discuss future directions, including multi-modal integration, personalized models, and facial attribute modification in animations, all of which are critical for the continued development and application of this technology.

Förderung

  • European Union’s Horizon 2020 research and innovation programme under the Marie Skłodowska-Curie

Zitieren

APA

Jiang, D., Chang, J., You, L., Bian, S., Kosk, R., & Maguire, G. (2024). Audio-Driven Facial Animation with Deep Learning: A Survey. Information, 15(11), 675. https://doi.org/10.3390/info15110675

Vancouver

Jiang D, Chang J, You L, Bian S, Kosk R, Maguire G. Audio-Driven Facial Animation with Deep Learning: A Survey. Information. 2024;15(11):675. doi:10.3390/info15110675

BibTeX
@article{Jiang2024,
  author = {Jiang, Diqiong and Chang, Jian and You, Lihua and Bian, Shaojun and Kosk, Robert and Maguire, Greg},
  title = {Audio-Driven Facial Animation with Deep Learning: A Survey},
  journal = {Information},
  year = {2024},
  volume = {15},
  number = {11},
  pages = {675},
  doi = {10.3390/info15110675}
}
Kostenlos starten →