Follow-Your-Click: Open-domain Regional Image Animation via Motion Prompts
Proceedings of the AAAI Conference on Artificial Intelligence · 11.04.2025 · 39 (6) · 6018-6026
DOI: 10.1609/aaai.v39i6.32643 ↗Kurz gefasst
Fachartikel in der Zeitschrift Proceedings of the AAAI Conference on Artificial Intelligence, online erschienen am 11.04.2025. Verfasst von Yue Ma und 11 weiteren Autor:innen. Die Arbeit wurde bisher 35-mal zitiert (Crossref).
Abstract (Originalsprache)
Despite recent advances in image-to-video generation, better controllability and local animation are less explored. Most existing image-to-video methods are not locally aware and tend to move the entire scene. However, human artists may need to control the movement of different objects or regions. Additionally, current I2V methods require users not only to describe the target motion but also to provide redundant detailed descriptions of frame contents.These two issues hinder the practical utilization of current I2V tools. In this paper, we propose a practical framework, named Follow-Your-Click, to achieve image animation with a simple user click (for specifying what to move) and a motion prompt (for specifying how to move). Technically, we propose the first-frame masking strategy, which significantly improves the video generation quality, and a motion-augmented module equipped with a motion prompt dataset to improve the motion prompt following abilities of our model. To further control the motion speed, we propose flow-based motion magnitude control to control the speed of target movement more precisely. Extensive experiments compared with 7 baselines, including both commercial tools and research methods on 8 metrics, suggest the superiority of our approach.
Zitieren
APA
Ma, Y., He, Y., Wang, H., Wang, A., Shen, L., Qi, C., Ying, J., Cai, C., Li, Z., Shum, H., Liu, W., & Chen, Q. (2025). Follow-Your-Click: Open-domain Regional Image Animation via Motion Prompts. Proceedings of the AAAI Conference on Artificial Intelligence, 39(6), 6018-6026. https://doi.org/10.1609/aaai.v39i6.32643
Vancouver
Ma Y, He Y, Wang H, Wang A, Shen L, Qi C, et al. Follow-Your-Click: Open-domain Regional Image Animation via Motion Prompts. Proceedings of the AAAI Conference on Artificial Intelligence. 2025;39(6):6018-6026. doi:10.1609/aaai.v39i6.32643
BibTeX
@article{Ma2025,
author = {Ma, Yue and He, Yingqing and Wang, Hongfa and Wang, Andong and Shen, Leqi and Qi, Chenyang and Ying, Jixuan and Cai, Chengfei and Li, Zhifeng and Shum, Heung-Yeung and Liu, Wei and Chen, Qifeng},
title = {Follow-Your-Click: Open-domain Regional Image Animation via Motion Prompts},
journal = {Proceedings of the AAAI Conference on Artificial Intelligence},
year = {2025},
volume = {39},
number = {6},
pages = {6018--6026},
doi = {10.1609/aaai.v39i6.32643}
}
EUVIMED