SteerMusic: Enhanced Musical Consistency for Zero-shot Text-Guided and Personalized Music Editing
Proceedings of the AAAI Conference on Artificial Intelligence · 14.03.2026 · 40 (3) · 2000-2010
DOI: 10.1609/aaai.v40i3.37181 ↗Kurz gefasst
Fachartikel in der Zeitschrift Proceedings of the AAAI Conference on Artificial Intelligence, online erschienen am 14.03.2026. Verfasst von Xinlei Niu und 10 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref).
Abstract (Originalsprache)
Music editing is an important step in music production, which has broad applications, including game development and film production. Most existing zero-shot text-guided editing methods rely on pretrained diffusion models by involving forward-backward diffusion processes. However, these methods often struggle to preserve the musical content. Additionally, text instructions alone usually fail to accurately describe the desired music. In this paper, we propose two music editing methods that improve the consistency between the original and edited music by leveraging score distillation. The first method, SteerMusic, is a coarse-grained zero-shot editing approach using delta denoising score. The second method, SteerMusic+, enables fine-grained personalized music editing by manipulating a concept token that represents a user-defined musical style. SteerMusic+ allows for the editing of music into user-defined musical styles that cannot be achieved by the text instructions alone. Experimental results show that our methods outperform existing approaches in preserving both music content consistency and editing fidelity. User studies further validate that our methods achieve superior music editing quality.
Zitieren
APA
Niu, X., Cheuk, K. W., Zhang, J., Murata, N., Lai, C., Mancusi, M., Choi, W., Fabbro, G., Liao, W., Martin, C. P., & Mitsufuji, Y. (2026). SteerMusic: Enhanced Musical Consistency for Zero-shot Text-Guided and Personalized Music Editing. Proceedings of the AAAI Conference on Artificial Intelligence, 40(3), 2000-2010. https://doi.org/10.1609/aaai.v40i3.37181
Vancouver
Niu X, Cheuk KW, Zhang J, Murata N, Lai C, Mancusi M, et al. SteerMusic: Enhanced Musical Consistency for Zero-shot Text-Guided and Personalized Music Editing. Proceedings of the AAAI Conference on Artificial Intelligence. 2026;40(3):2000-2010. doi:10.1609/aaai.v40i3.37181
BibTeX
@article{Niu2026,
author = {Niu, Xinlei and Cheuk, Kin Wai and Zhang, Jing and Murata, Naoki and Lai, Chieh-Hsin and Mancusi, Michele and Choi, Woosung and Fabbro, Giorgio and Liao, Wei-Hsiang and Martin, Charles Patrick and Mitsufuji, Yuki},
title = {SteerMusic: Enhanced Musical Consistency for Zero-shot Text-Guided and Personalized Music Editing},
journal = {Proceedings of the AAAI Conference on Artificial Intelligence},
year = {2026},
volume = {40},
number = {3},
pages = {2000--2010},
doi = {10.1609/aaai.v40i3.37181}
}
EUVIMED