AI killed the Video Star. Audio-Driven Diffusion Model for Expressive Talking Head Generation
International Journal of Computer Vision · 2026-05 · 134 (5)
DOI: 10.1007/s11263-026-02766-7 ↗Kurz gefasst
Fachartikel in der Zeitschrift International Journal of Computer Vision, online erschienen am 21.04.2026. Verfasst von Baptiste Chopin und 4 weiteren Autor:innen. Die Arbeit wurde bisher 3-mal zitiert (Crossref) und nennt 76 Literaturangaben.
Abstract (Originalsprache)
We propose Dimitra++, a novel framework for audio-driven talking head generation, streamlined to learn lip motion, facial expression, as well as head pose motion. Specifically, we propose a conditional Motion Diffusion Transformer (cMDT) to model facial motion sequences, employing a 3D representation. The cMDT is conditioned on two inputs: a reference facial image, which determines appearance, as well as an audio sequence, which drives the motion. Quantitative and qualitative experiments, as well as a user study on two widely employed datasets, i.e., VoxCeleb2 and CelebV-HQ, suggest that Dimitra++ is able to outperform existing approaches in generating realistic talking heads imparting lip motion, facial expression, and head pose. Code and qualitative results are provided on our project page: https://tashvikdhamija.github.io/dimitra/.
Zitieren
APA
Chopin, B., Dhamija, T., Balaji, P., Wang, Y., & Dantcheva, A. (2026). AI killed the Video Star. Audio-Driven Diffusion Model for Expressive Talking Head Generation. International Journal of Computer Vision, 134(5). https://doi.org/10.1007/s11263-026-02766-7
Vancouver
Chopin B, Dhamija T, Balaji P, Wang Y, Dantcheva A. AI killed the Video Star. Audio-Driven Diffusion Model for Expressive Talking Head Generation. International Journal of Computer Vision. 2026;134(5). doi:10.1007/s11263-026-02766-7
BibTeX
@article{Chopin2026,
author = {Chopin, Baptiste and Dhamija, Tashvik and Balaji, Pranav and Wang, Yaohui and Dantcheva, Antitza},
title = {AI killed the Video Star. Audio-Driven Diffusion Model for Expressive Talking Head Generation},
journal = {International Journal of Computer Vision},
year = {2026},
volume = {134},
number = {5},
doi = {10.1007/s11263-026-02766-7}
}
EUVIMED