EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC-ND 4.0

Advancements in talking head generation: a comprehensive review of techniques, metrics, and challenges

Vineet Kumar Rakesh, Soumya Mazumdar, Research Pratim Maity, Sarbajit Pal, Amitabha Das, Tapas Samanta

The Visual Computer · 2026-01 · 42 (1)

DOI: 10.1007/s00371-025-04232-w ↗

Kurz gefasst

Fachartikel in der Zeitschrift The Visual Computer, online erschienen am 04.12.2025. Verfasst von Vineet Kumar Rakesh und 5 weiteren Autor:innen. Die Arbeit wurde bisher 6-mal zitiert (Crossref) und nennt 226 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0). Gefördert von: Variable Energy Cyclotron Centre.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Talking head generation (THG) has emerged as a transformative technology in computer vision, synthesizing realistic human faces synchronized with audio, image, text, or video inputs. This paper systematically reviews THG methodologies and frameworks, categorizing approaches into 2D-based, 3D-based, Neural Radiance Fields (NeRF)-based, diffusion-based, and other techniques. We explore the most effective approaches in THG, emphasizing training techniques that improve realism, identity preservation, and motion accuracy. THG has vast potential applications, including creating digital avatars, dubbing videos, enhancing virtual assistants, and improving video calls. However, challenges include needing large models, handling extreme head movements, maintaining language synchronicity, and ensuring smooth visuals persist. This review provides a comprehensive overview of current progress, identifies ongoing challenges, and suggests future research directions, including developing simpler and more adaptable models, enabling real-time processing on smaller devices, and creating ethical guidelines. By summarizing existing research and highlighting ongoing challenges, this overview offers valuable insights for anyone interested in future of talking head technology. For the complete survey, code, and curated resource list, visit our GitHub repository: https://github.com/VineetKumarRakesh/thg.

Förderung

  • Variable Energy Cyclotron Centre

Zitieren

APA

Rakesh, V. K., Mazumdar, S., Maity, R. P., Pal, S., Das, A., & Samanta, T. (2026). Advancements in talking head generation: a comprehensive review of techniques, metrics, and challenges. The Visual Computer, 42(1). https://doi.org/10.1007/s00371-025-04232-w

Vancouver

Rakesh VK, Mazumdar S, Maity RP, Pal S, Das A, Samanta T. Advancements in talking head generation: a comprehensive review of techniques, metrics, and challenges. The Visual Computer. 2026;42(1). doi:10.1007/s00371-025-04232-w

BibTeX
@article{Rakesh2026,
  author = {Rakesh, Vineet Kumar and Mazumdar, Soumya and Maity, Research Pratim and Pal, Sarbajit and Das, Amitabha and Samanta, Tapas},
  title = {Advancements in talking head generation: a comprehensive review of techniques, metrics, and challenges},
  journal = {The Visual Computer},
  year = {2026},
  volume = {42},
  number = {1},
  doi = {10.1007/s00371-025-04232-w}
}
Kostenlos starten →