A Comprehensive Survey on Generative AI for Video-to-Music Generation
ACM Computing Surveys · 31.10.2026 · 58 (13) · 1-36
DOI: 10.1145/3816020 ↗Kurz gefasst
Fachartikel in der Zeitschrift ACM Computing Surveys, online erschienen am 24.06.2026. Verfasst von Shulei Ji und 4 weiteren Autor:innen. Die Arbeit nennt 172 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0). Gefördert von: National Natural Science Foundation of China.
Abstract (Originalsprache)
The burgeoning growth of video-to-music generation can be attributed to the ascendancy of multimodal generative models. However, there is a lack of literature that comprehensively combs through the work in this field. To fill this gap, this article presents a comprehensive review of video-to-music generation using deep generative AI techniques, focusing on three key components: conditioning input construction, conditioning mechanism, and music generation frameworks. We categorize existing approaches based on their designs for each component, clarifying the roles of different strategies. Preceding this, we provide a fine-grained categorization of video and music modalities, illustrating how different categories influence the design of components within the generation pipelines. Furthermore, we summarize available multimodal datasets and evaluation metrics while highlighting ongoing challenges in the field.
Förderung
- National Natural Science Foundation of China
Zitieren
APA
Ji, S., Wu, S., Wang, Z., Li, S., & Zhang, K. (2026). A Comprehensive Survey on Generative AI for Video-to-Music Generation. ACM Computing Surveys, 58(13), 1-36. https://doi.org/10.1145/3816020
Vancouver
Ji S, Wu S, Wang Z, Li S, Zhang K. A Comprehensive Survey on Generative AI for Video-to-Music Generation. ACM Computing Surveys. 2026;58(13):1-36. doi:10.1145/3816020
BibTeX
@article{Ji2026,
author = {Ji, Shulei and Wu, Songruoyao and Wang, Zihao and Li, Shuyu and Zhang, Kejun},
title = {A Comprehensive Survey on Generative AI for Video-to-Music Generation},
journal = {ACM Computing Surveys},
year = {2026},
volume = {58},
number = {13},
pages = {1--36},
doi = {10.1145/3816020}
}
EUVIMED