Deep Learning-Based Action Detection in Untrimmed Videos: A Survey
IEEE Transactions on Pattern Analysis and Machine Intelligence · 01.04.2023 · 45 (4) · 4302-4320
DOI: 10.1109/tpami.2022.3193611 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Pattern Analysis and Machine Intelligence, erschienen am 01.04.2023. Verfasst von Elahe Vahdani und 1 weiteren Autor:innen. Die Arbeit wurde bisher 87-mal zitiert (Crossref) und nennt 235 Literaturangaben. Gefördert von: National Science Foundation.
Abstract (Originalsprache)
Understanding human behavior and activity facilitates advancement of numerous real-world applications, and is critical for video analysis. Despite the progress of action recognition algorithms in trimmed videos, the majority of real-world videos are lengthy and untrimmed with sparse segments of interest. The task of temporal activity detection in untrimmed videos aims to localize the temporal boundary of actions and classify the action categories. Temporal activity detection task has been investigated in full and limited supervision settings depending on the availability of action annotations. This article provides an extensive overview of deep learning-based algorithms to tackle temporal action detection in untrimmed videos with different supervision levels including fully-supervised, weakly-supervised, unsupervised, self-supervised, and semi-supervised. In addition, this article reviews advances in spatio-temporal action detection where actions are localized in both temporal and spatial dimensions. Action detection in online setting is also reviewed where the goal is to detect actions in each frame without considering any future context in a live video stream. Moreover, the commonly used action detection benchmark datasets and evaluation metrics are described, and the performance of the state-of-the-art methods are compared. Finally, real-world applications of temporal action detection in untrimmed videos and a set of future directions are discussed.
Förderung
- National Science Foundation
Zitieren
APA
Vahdani, E., & Tian, Y. (2023). Deep Learning-Based Action Detection in Untrimmed Videos: A Survey. IEEE Transactions on Pattern Analysis and Machine Intelligence, 45(4), 4302-4320. https://doi.org/10.1109/tpami.2022.3193611
Vancouver
Vahdani E, Tian Y. Deep Learning-Based Action Detection in Untrimmed Videos: A Survey. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2023;45(4):4302-4320. doi:10.1109/tpami.2022.3193611
BibTeX
@article{Vahdani2023,
author = {Vahdani, Elahe and Tian, Yingli},
title = {Deep Learning-Based Action Detection in Untrimmed Videos: A Survey},
journal = {IEEE Transactions on Pattern Analysis and Machine Intelligence},
year = {2023},
volume = {45},
number = {4},
pages = {4302--4320},
doi = {10.1109/tpami.2022.3193611}
}
EUVIMED