EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

FFCI: A Camera and IMU Sensors-Based Multi-Modal Neural Network for Activity Recognition in Smart Factory

Yujue Wang, Xin Niu, Xianwei Lv, Chen Yu

IEEE Transactions on Consumer Electronics · 2025-05 · 71 (2) · 6528-6538

DOI: 10.1109/tce.2025.3534236 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Consumer Electronics, 2025-05. Verfasst von Yujue Wang und 3 weiteren Autor:innen. Die Arbeit wurde bisher 9-mal zitiert (Crossref) und nennt 44 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: NSFC.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Worker activity recognition is an important aspect of the construction of smart factory. The development of deep neural networks and the widespread distribution of sensors in the smart factory have brought opportunities for the recognition of workers’ activities. The existing methods based on camera and IMU sensors respectively have problems of visual occlusion and difficulty in recognition of similar activities, which result in the reduction of recognition accuracy. Therefore, we propose a feature-level fusion based on camera and IMU sensor (FFCI) for activity recognition in smart factory. The FFCI employs an optimized multi-modal fusion strategy to integrate the visual information and the action information of workers’ activities. In order to verify the effectiveness of FFCI, we define a simple yet fine-grained assembly task and collect six common operations. Furthermore, we add visual occlusion and similar activity data to get closer to the smart factory. Finally, we evaluate the FFCI on the collected dataset and achieve a recognition accuracy of 98.17%, demonstrating its effectiveness in accurately classifying workers’ activities.

Förderung

  • NSFC

Zitieren

APA

Wang, Y., Niu, X., Lv, X., & Yu, C. (2025). FFCI: A Camera and IMU Sensors-Based Multi-Modal Neural Network for Activity Recognition in Smart Factory. IEEE Transactions on Consumer Electronics, 71(2), 6528-6538. https://doi.org/10.1109/tce.2025.3534236

Vancouver

Wang Y, Niu X, Lv X, Yu C. FFCI: A Camera and IMU Sensors-Based Multi-Modal Neural Network for Activity Recognition in Smart Factory. IEEE Transactions on Consumer Electronics. 2025;71(2):6528-6538. doi:10.1109/tce.2025.3534236

BibTeX
@article{Wang2025,
  author = {Wang, Yujue and Niu, Xin and Lv, Xianwei and Yu, Chen},
  title = {FFCI: A Camera and IMU Sensors-Based Multi-Modal Neural Network for Activity Recognition in Smart Factory},
  journal = {IEEE Transactions on Consumer Electronics},
  year = {2025},
  volume = {71},
  number = {2},
  pages = {6528--6538},
  doi = {10.1109/tce.2025.3534236}
}
Kostenlos starten →