EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC-ND 4.0

Novel vision‐LiDAR fusion framework for human action recognition based on dynamic lateral connection

Fei Yan, Guangyao Jin, Zheng Mu, Shouxing Zhang, Yinghao Cai, Tao Lu, Yan Zhuang

IET Cyber-Systems and Robotics · 2024-12 · 6 (4)

DOI: 10.1049/csy2.70005 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IET Cyber-Systems and Robotics, online erschienen am 31.12.2024. Verfasst von Fei Yan und 6 weiteren Autor:innen. Die Arbeit wurde bisher 3-mal zitiert (Crossref) und nennt 35 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0). Gefördert von: National Key Research and Development Program of China, National Natural Science Foundation of China.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

In the past decades, substantial progress has been made in human action recognition. However, most existing studies and datasets for human action recognition utilise still images or videos as the primary modality. Image‐based approaches can be easily impacted by adverse environmental conditions. In this paper, the authors propose combining RGB images and point clouds from LiDAR sensors for human action recognition. A dynamic lateral convolutional network (DLCN) is proposed to fuse features from multi‐modalities. The RGB features and the geometric information from the point clouds closely interact with each other in the DLCN, which is complementary in action recognition. The experimental results on the JRDB‐Act dataset demonstrate that the proposed DLCN outperforms the state‐of‐the‐art approaches of human action recognition. The authors show the potential of the proposed DLCN in various complex scenarios, which is highly valuable in real‐world applications.

Förderung

  • National Key Research and Development Program of China
  • National Natural Science Foundation of China

Zitieren

APA

Yan, F., Jin, G., Mu, Z., Zhang, S., Cai, Y., Lu, T., & Zhuang, Y. (2024). Novel vision‐LiDAR fusion framework for human action recognition based on dynamic lateral connection. IET Cyber-Systems and Robotics, 6(4). https://doi.org/10.1049/csy2.70005

Vancouver

Yan F, Jin G, Mu Z, Zhang S, Cai Y, Lu T, et al. Novel vision‐LiDAR fusion framework for human action recognition based on dynamic lateral connection. IET Cyber-Systems and Robotics. 2024;6(4). doi:10.1049/csy2.70005

BibTeX
@article{Yan2024,
  author = {Yan, Fei and Jin, Guangyao and Mu, Zheng and Zhang, Shouxing and Cai, Yinghao and Lu, Tao and Zhuang, Yan},
  title = {Novel vision‐LiDAR fusion framework for human action recognition based on dynamic lateral connection},
  journal = {IET Cyber-Systems and Robotics},
  year = {2024},
  volume = {6},
  number = {4},
  doi = {10.1049/csy2.70005}
}
Kostenlos starten →