EUVIMEDEUVIMED entdecken
Crossref

Follow-Your-Click: Open-domain Regional Image Animation via Motion Prompts

Yue Ma, Yingqing He, Hongfa Wang, Andong Wang, Leqi Shen, Chenyang Qi, Jixuan Ying, Chengfei Cai, Zhifeng Li, Heung-Yeung Shum, Wei Liu, Qifeng Chen

Proceedings of the AAAI Conference on Artificial Intelligence · 11.04.2025 · 39 (6) · 6018-6026

DOI: 10.1609/aaai.v39i6.32643 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Proceedings of the AAAI Conference on Artificial Intelligence, online erschienen am 11.04.2025. Verfasst von Yue Ma und 11 weiteren Autor:innen. Die Arbeit wurde bisher 35-mal zitiert (Crossref).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Despite recent advances in image-to-video generation, better controllability and local animation are less explored. Most existing image-to-video methods are not locally aware and tend to move the entire scene. However, human artists may need to control the movement of different objects or regions. Additionally, current I2V methods require users not only to describe the target motion but also to provide redundant detailed descriptions of frame contents.These two issues hinder the practical utilization of current I2V tools. In this paper, we propose a practical framework, named Follow-Your-Click, to achieve image animation with a simple user click (for specifying what to move) and a motion prompt (for specifying how to move). Technically, we propose the first-frame masking strategy, which significantly improves the video generation quality, and a motion-augmented module equipped with a motion prompt dataset to improve the motion prompt following abilities of our model. To further control the motion speed, we propose flow-based motion magnitude control to control the speed of target movement more precisely. Extensive experiments compared with 7 baselines, including both commercial tools and research methods on 8 metrics, suggest the superiority of our approach.

Zitieren

APA

Ma, Y., He, Y., Wang, H., Wang, A., Shen, L., Qi, C., Ying, J., Cai, C., Li, Z., Shum, H., Liu, W., & Chen, Q. (2025). Follow-Your-Click: Open-domain Regional Image Animation via Motion Prompts. Proceedings of the AAAI Conference on Artificial Intelligence, 39(6), 6018-6026. https://doi.org/10.1609/aaai.v39i6.32643

Vancouver

Ma Y, He Y, Wang H, Wang A, Shen L, Qi C, et al. Follow-Your-Click: Open-domain Regional Image Animation via Motion Prompts. Proceedings of the AAAI Conference on Artificial Intelligence. 2025;39(6):6018-6026. doi:10.1609/aaai.v39i6.32643

BibTeX
@article{Ma2025,
  author = {Ma, Yue and He, Yingqing and Wang, Hongfa and Wang, Andong and Shen, Leqi and Qi, Chenyang and Ying, Jixuan and Cai, Chengfei and Li, Zhifeng and Shum, Heung-Yeung and Liu, Wei and Chen, Qifeng},
  title = {Follow-Your-Click: Open-domain Regional Image Animation via Motion Prompts},
  journal = {Proceedings of the AAAI Conference on Artificial Intelligence},
  year = {2025},
  volume = {39},
  number = {6},
  pages = {6018--6026},
  doi = {10.1609/aaai.v39i6.32643}
}
Kostenlos starten →