EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC-ND 4.0

A Comprehensive Survey on Generative AI for Video-to-Music Generation

Shulei Ji, Songruoyao Wu, Zihao Wang, Shuyu Li, Kejun Zhang

ACM Computing Surveys · 31.10.2026 · 58 (13) · 1-36

DOI: 10.1145/3816020 ↗

Kurz gefasst

Fachartikel in der Zeitschrift ACM Computing Surveys, online erschienen am 24.06.2026. Verfasst von Shulei Ji und 4 weiteren Autor:innen. Die Arbeit nennt 172 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0). Gefördert von: National Natural Science Foundation of China.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The burgeoning growth of video-to-music generation can be attributed to the ascendancy of multimodal generative models. However, there is a lack of literature that comprehensively combs through the work in this field. To fill this gap, this article presents a comprehensive review of video-to-music generation using deep generative AI techniques, focusing on three key components: conditioning input construction, conditioning mechanism, and music generation frameworks. We categorize existing approaches based on their designs for each component, clarifying the roles of different strategies. Preceding this, we provide a fine-grained categorization of video and music modalities, illustrating how different categories influence the design of components within the generation pipelines. Furthermore, we summarize available multimodal datasets and evaluation metrics while highlighting ongoing challenges in the field.

Förderung

  • National Natural Science Foundation of China

Zitieren

APA

Ji, S., Wu, S., Wang, Z., Li, S., & Zhang, K. (2026). A Comprehensive Survey on Generative AI for Video-to-Music Generation. ACM Computing Surveys, 58(13), 1-36. https://doi.org/10.1145/3816020

Vancouver

Ji S, Wu S, Wang Z, Li S, Zhang K. A Comprehensive Survey on Generative AI for Video-to-Music Generation. ACM Computing Surveys. 2026;58(13):1-36. doi:10.1145/3816020

BibTeX
@article{Ji2026,
  author = {Ji, Shulei and Wu, Songruoyao and Wang, Zihao and Li, Shuyu and Zhang, Kejun},
  title = {A Comprehensive Survey on Generative AI for Video-to-Music Generation},
  journal = {ACM Computing Surveys},
  year = {2026},
  volume = {58},
  number = {13},
  pages = {1--36},
  doi = {10.1145/3816020}
}
Kostenlos starten →