EUVIMEDEUVIMED entdecken
Crossref

Deep Learning-Based Action Detection in Untrimmed Videos: A Survey

Elahe Vahdani, Yingli Tian

IEEE Transactions on Pattern Analysis and Machine Intelligence · 01.04.2023 · 45 (4) · 4302-4320

DOI: 10.1109/tpami.2022.3193611 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Pattern Analysis and Machine Intelligence, erschienen am 01.04.2023. Verfasst von Elahe Vahdani und 1 weiteren Autor:innen. Die Arbeit wurde bisher 87-mal zitiert (Crossref) und nennt 235 Literaturangaben. Gefördert von: National Science Foundation.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Understanding human behavior and activity facilitates advancement of numerous real-world applications, and is critical for video analysis. Despite the progress of action recognition algorithms in trimmed videos, the majority of real-world videos are lengthy and untrimmed with sparse segments of interest. The task of temporal activity detection in untrimmed videos aims to localize the temporal boundary of actions and classify the action categories. Temporal activity detection task has been investigated in full and limited supervision settings depending on the availability of action annotations. This article provides an extensive overview of deep learning-based algorithms to tackle temporal action detection in untrimmed videos with different supervision levels including fully-supervised, weakly-supervised, unsupervised, self-supervised, and semi-supervised. In addition, this article reviews advances in spatio-temporal action detection where actions are localized in both temporal and spatial dimensions. Action detection in online setting is also reviewed where the goal is to detect actions in each frame without considering any future context in a live video stream. Moreover, the commonly used action detection benchmark datasets and evaluation metrics are described, and the performance of the state-of-the-art methods are compared. Finally, real-world applications of temporal action detection in untrimmed videos and a set of future directions are discussed.

Förderung

  • National Science Foundation

Zitieren

APA

Vahdani, E., & Tian, Y. (2023). Deep Learning-Based Action Detection in Untrimmed Videos: A Survey. IEEE Transactions on Pattern Analysis and Machine Intelligence, 45(4), 4302-4320. https://doi.org/10.1109/tpami.2022.3193611

Vancouver

Vahdani E, Tian Y. Deep Learning-Based Action Detection in Untrimmed Videos: A Survey. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2023;45(4):4302-4320. doi:10.1109/tpami.2022.3193611

BibTeX
@article{Vahdani2023,
  author = {Vahdani, Elahe and Tian, Yingli},
  title = {Deep Learning-Based Action Detection in Untrimmed Videos: A Survey},
  journal = {IEEE Transactions on Pattern Analysis and Machine Intelligence},
  year = {2023},
  volume = {45},
  number = {4},
  pages = {4302--4320},
  doi = {10.1109/tpami.2022.3193611}
}
Kostenlos starten →