Eventfulness for Interactive Video Alignment
ACM Transactions on Graphics · 2023-08 · 42 (4) · 1-10
DOI: 10.1145/3592118 ↗Kurz gefasst
Fachartikel in der Zeitschrift ACM Transactions on Graphics, online erschienen am 26.07.2023. Verfasst von Jiatian Sun und 4 weiteren Autor:innen. Die Arbeit wurde bisher 9-mal zitiert (Crossref) und nennt 50 Literaturangaben.
Abstract (Originalsprache)
Humans are remarkably sensitive to the alignment of visual events with other stimuli, which makes synchronization one of the hardest tasks in video editing. A key observation of our work is that most of the alignment we do involves salient localizable events that occur sparsely in time. By learning how to recognize these events, we can greatly reduce the space of possible synchronizations that an editor or algorithm has to consider. Furthermore, by learning descriptors of these events that capture additional properties of visible motion, we can build active tools that adapt their notion of eventfulness to a given task as they are being used. Rather than learning an automatic solution to one specific problem, our goal is to make a much broader class of interactive alignment tasks significantly easier and less time-consuming. We show that a suitable visual event descriptor can be learned entirely from stochastically-generated synthetic video. We then demonstrate the usefulness of learned and adaptive eventfulness by integrating it in novel interactive tools for applications including audio-driven time warping of video and the extraction and application of sound effects across different videos.
Zitieren
APA
Sun, J., Deng, L., Afouras, T., Owens, A., & Davis, A. (2023). Eventfulness for Interactive Video Alignment. ACM Transactions on Graphics, 42(4), 1-10. https://doi.org/10.1145/3592118
Vancouver
Sun J, Deng L, Afouras T, Owens A, Davis A. Eventfulness for Interactive Video Alignment. ACM Transactions on Graphics. 2023;42(4):1-10. doi:10.1145/3592118
BibTeX
@article{Sun2023,
author = {Sun, Jiatian and Deng, Longxiulin and Afouras, Triantafyllos and Owens, Andrew and Davis, Abe},
title = {Eventfulness for Interactive Video Alignment},
journal = {ACM Transactions on Graphics},
year = {2023},
volume = {42},
number = {4},
pages = {1--10},
doi = {10.1145/3592118}
}
EUVIMED