EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Object Recognition Using Deep Learning‐Powered Glove With Flex and MPU Sensors Fusion

Joao Andre Ndombasi Diakusala, Zhigeng Pan, Ginias Lulendo Kiveni, Nenglun Chen, Habachi Bilal, Marcellin Atemkeng, Thierry Bouwmans, M. D. Sabbir Rahman, Ange Ntokusi, Sébastien Lalléchère, Blaise Ravelo

Journal of Robotics · 2026-01 · 2026 (1)

DOI: 10.1155/joro/6642796 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Robotics, online erschienen am 26.03.2026. Verfasst von Joao Andre Ndombasi Diakusala und 10 weiteren Autor:innen. Die Arbeit nennt 31 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Research Foundation.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The integration of multimodal sensor data is critical for developing intelligent systems capable of extracting complex, insightful information. We introduce a robust platform for high‐fidelity and real‐time hand posture replication, as well as object classification, centered on a novel tactile‐sensing glove. The glove design incorporates 10 flex sensors spanning the PIP and MCP joints, complemented by two MPU6050 IMUs strategically mounted on the thumb’s TM and the hand’s dorsal CMC bones for comprehensive motion capture. We leverage this rich sensory data to drive a digital twin—constructed in Blender and visualized in the Unity3D engine—achieving precise real‐time hand posture reproduction, necessary for visual feedback and sensor anomaly detection during sensor calibration and data collection by the operator. Furthermore, we evaluate the glove’s classification capability on a custom dataset of 15 objects. Through a grid search optimization, we trained One‐dimensional Convolutional Neural Network (CNN‐1D), Long‐Short Term Memory (LSTM), and Temporal Convolutional Network (TCN) architectures. The models achieved classification testing accuracies confidence intervals of [95.40%, 96.50%], [92.55%, 93.84%], and [93.47%, 94.76%], respectively, validating the high‐performance and utility of our multimodal sensing approach.

Förderung

  • National Research Foundation

Zitieren

APA

Diakusala, J. A. N., Pan, Z., Kiveni, G. L., Chen, N., Bilal, H., Atemkeng, M., Bouwmans, T., Rahman, M. D. S., Ntokusi, A., Lalléchère, S., & Ravelo, B. (2026). Object Recognition Using Deep Learning‐Powered Glove With Flex and MPU Sensors Fusion. Journal of Robotics, 2026(1). https://doi.org/10.1155/joro/6642796

Vancouver

Diakusala JAN, Pan Z, Kiveni GL, Chen N, Bilal H, Atemkeng M, et al. Object Recognition Using Deep Learning‐Powered Glove With Flex and MPU Sensors Fusion. Journal of Robotics. 2026;2026(1). doi:10.1155/joro/6642796

BibTeX
@article{Diakusala2026,
  author = {Diakusala, Joao Andre Ndombasi and Pan, Zhigeng and Kiveni, Ginias Lulendo and Chen, Nenglun and Bilal, Habachi and Atemkeng, Marcellin and Bouwmans, Thierry and Rahman, M. D. Sabbir and Ntokusi, Ange and Lalléchère, Sébastien and Ravelo, Blaise},
  title = {Object Recognition Using Deep Learning‐Powered Glove With Flex and MPU Sensors Fusion},
  journal = {Journal of Robotics},
  year = {2026},
  volume = {2026},
  number = {1},
  doi = {10.1155/joro/6642796}
}
Kostenlos starten →