AniClipart: Clipart Animation with Text-to-Video Priors
International Journal of Computer Vision · 2025-06 · 133 (6) · 3149-3165
DOI: 10.1007/s11263-024-02306-1 ↗Kurz gefasst
Fachartikel in der Zeitschrift International Journal of Computer Vision, online erschienen am 27.12.2024. Verfasst von Ronghuan Wu und 3 weiteren Autor:innen. Die Arbeit wurde bisher 9-mal zitiert (Crossref) und nennt 105 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Research Grants Council (RGC) of Hong Kong.
Abstract (Originalsprache)
Clipart, a pre-made graphic art form, offers a convenient and efficient way of illustrating visual content. Traditional workflows to convert static clipart images into motion sequences are laborious and time-consuming, involving numerous intricate steps like rigging, key animation and in-betweening. Recent advancements in text-to-video generation hold great potential in resolving this problem. Nevertheless, direct application of text-to-video generation models often struggles to retain the visual identity of clipart images or generate cartoon-style motions, resulting in unsatisfactory animation outcomes. In this paper, we introduce AniClipart, a system that transforms static clipart images into high-quality motion sequences guided by text-to-video priors. To generate cartoon-style and smooth motion, we first define Bézier curves over keypoints of the clipart image as a form of motion regularization. We then align the motion trajectories of the keypoints with the provided text prompt by optimizing the Video Score Distillation Sampling (VSDS) loss, which encodes adequate knowledge of natural motion within a pretrained text-to-video diffusion model. With a differentiable As-Rigid-As-Possible shape deformation algorithm, our method can be end-to-end optimized while maintaining deformation rigidity. Experimental results show that the proposed AniClipart consistently outperforms existing image-to-video generation models, in terms of text-video alignment, visual identity preservation, and motion consistency. Furthermore, we showcase the versatility of AniClipart by adapting it to generate a broader array of animation formats, such as layered animation, which allows topological changes.
Förderung
- Research Grants Council (RGC) of Hong Kong
Zitieren
APA
Wu, R., Su, W., Ma, K., & Liao, J. (2025). AniClipart: Clipart Animation with Text-to-Video Priors. International Journal of Computer Vision, 133(6), 3149-3165. https://doi.org/10.1007/s11263-024-02306-1
Vancouver
Wu R, Su W, Ma K, Liao J. AniClipart: Clipart Animation with Text-to-Video Priors. International Journal of Computer Vision. 2025;133(6):3149-3165. doi:10.1007/s11263-024-02306-1
BibTeX
@article{Wu2025,
author = {Wu, Ronghuan and Su, Wanchao and Ma, Kede and Liao, Jing},
title = {AniClipart: Clipart Animation with Text-to-Video Priors},
journal = {International Journal of Computer Vision},
year = {2025},
volume = {133},
number = {6},
pages = {3149--3165},
doi = {10.1007/s11263-024-02306-1}
}
EUVIMED