EUVIMEDEUVIMED entdecken
Crossref

SteerMusic: Enhanced Musical Consistency for Zero-shot Text-Guided and Personalized Music Editing

Xinlei Niu, Kin Wai Cheuk, Jing Zhang, Naoki Murata, Chieh-Hsin Lai, Michele Mancusi, Woosung Choi, Giorgio Fabbro, Wei-Hsiang Liao, Charles Patrick Martin, Yuki Mitsufuji

Proceedings of the AAAI Conference on Artificial Intelligence · 14.03.2026 · 40 (3) · 2000-2010

DOI: 10.1609/aaai.v40i3.37181 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Proceedings of the AAAI Conference on Artificial Intelligence, online erschienen am 14.03.2026. Verfasst von Xinlei Niu und 10 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Music editing is an important step in music production, which has broad applications, including game development and film production. Most existing zero-shot text-guided editing methods rely on pretrained diffusion models by involving forward-backward diffusion processes. However, these methods often struggle to preserve the musical content. Additionally, text instructions alone usually fail to accurately describe the desired music. In this paper, we propose two music editing methods that improve the consistency between the original and edited music by leveraging score distillation. The first method, SteerMusic, is a coarse-grained zero-shot editing approach using delta denoising score. The second method, SteerMusic+, enables fine-grained personalized music editing by manipulating a concept token that represents a user-defined musical style. SteerMusic+ allows for the editing of music into user-defined musical styles that cannot be achieved by the text instructions alone. Experimental results show that our methods outperform existing approaches in preserving both music content consistency and editing fidelity. User studies further validate that our methods achieve superior music editing quality.

Zitieren

APA

Niu, X., Cheuk, K. W., Zhang, J., Murata, N., Lai, C., Mancusi, M., Choi, W., Fabbro, G., Liao, W., Martin, C. P., & Mitsufuji, Y. (2026). SteerMusic: Enhanced Musical Consistency for Zero-shot Text-Guided and Personalized Music Editing. Proceedings of the AAAI Conference on Artificial Intelligence, 40(3), 2000-2010. https://doi.org/10.1609/aaai.v40i3.37181

Vancouver

Niu X, Cheuk KW, Zhang J, Murata N, Lai C, Mancusi M, et al. SteerMusic: Enhanced Musical Consistency for Zero-shot Text-Guided and Personalized Music Editing. Proceedings of the AAAI Conference on Artificial Intelligence. 2026;40(3):2000-2010. doi:10.1609/aaai.v40i3.37181

BibTeX
@article{Niu2026,
  author = {Niu, Xinlei and Cheuk, Kin Wai and Zhang, Jing and Murata, Naoki and Lai, Chieh-Hsin and Mancusi, Michele and Choi, Woosung and Fabbro, Giorgio and Liao, Wei-Hsiang and Martin, Charles Patrick and Mitsufuji, Yuki},
  title = {SteerMusic: Enhanced Musical Consistency for Zero-shot Text-Guided and Personalized Music Editing},
  journal = {Proceedings of the AAAI Conference on Artificial Intelligence},
  year = {2026},
  volume = {40},
  number = {3},
  pages = {2000--2010},
  doi = {10.1609/aaai.v40i3.37181}
}
Kostenlos starten →