EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Multimodal vision-based human action recognition using deep learning: a review

Fatemeh Shafizadegan, Ahmad R. Naghsh-Nilchi, Elham Shabaninia

Artificial Intelligence Review · 19.06.2024 · 57 (7)

DOI: 10.1007/s10462-024-10730-5 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Artificial Intelligence Review, online erschienen am 19.06.2024. Verfasst von Fatemeh Shafizadegan und 2 weiteren Autor:innen. Die Arbeit wurde bisher 53-mal zitiert (Crossref) und nennt 302 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Vision-based Human Action Recognition (HAR) is a hot topic in computer vision. Recently, deep-based HAR has shown promising results. HAR using a single data modality is a common approach; however, the fusion of different data sources essentially conveys complementary information and improves the results. This paper comprehensively reviews deep-based HAR methods using multiple visual data modalities. The main contribution of this paper is categorizing existing methods into four levels, which provides an in-depth and comparable analysis of approaches in various aspects. So, at the first level, proposed methods are categorized based on the employed modalities. At the second level, methods categorized in the first level are classified based on the employment of complete modalities or working with missing modalities at the test time. At the third level, complete and missing modality branches are categorized based on existing approaches. Finally, similar frameworks in the third category are grouped together. In addition, a comprehensive comparison is provided for publicly available benchmark datasets, which helps to compare and choose suitable datasets for a task or to develop new datasets. This paper also compares the performance of state-of-the-art methods on benchmark datasets. The review concludes by highlighting several future directions.

Zitieren

APA

Shafizadegan, F., Naghsh-Nilchi, A. R., & Shabaninia, E. (2024). Multimodal vision-based human action recognition using deep learning: a review. Artificial Intelligence Review, 57(7). https://doi.org/10.1007/s10462-024-10730-5

Vancouver

Shafizadegan F, Naghsh-Nilchi AR, Shabaninia E. Multimodal vision-based human action recognition using deep learning: a review. Artificial Intelligence Review. 2024;57(7). doi:10.1007/s10462-024-10730-5

BibTeX
@article{Shafizadegan2024,
  author = {Shafizadegan, Fatemeh and Naghsh-Nilchi, Ahmad R. and Shabaninia, Elham},
  title = {Multimodal vision-based human action recognition using deep learning: a review},
  journal = {Artificial Intelligence Review},
  year = {2024},
  volume = {57},
  number = {7},
  doi = {10.1007/s10462-024-10730-5}
}
Kostenlos starten →