Object Recognition Using Deep Learning‐Powered Glove With Flex and MPU Sensors Fusion
Journal of Robotics · 2026-01 · 2026 (1)
DOI: 10.1155/joro/6642796 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Robotics, online erschienen am 26.03.2026. Verfasst von Joao Andre Ndombasi Diakusala und 10 weiteren Autor:innen. Die Arbeit nennt 31 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Research Foundation.
Abstract (Originalsprache)
The integration of multimodal sensor data is critical for developing intelligent systems capable of extracting complex, insightful information. We introduce a robust platform for high‐fidelity and real‐time hand posture replication, as well as object classification, centered on a novel tactile‐sensing glove. The glove design incorporates 10 flex sensors spanning the PIP and MCP joints, complemented by two MPU6050 IMUs strategically mounted on the thumb’s TM and the hand’s dorsal CMC bones for comprehensive motion capture. We leverage this rich sensory data to drive a digital twin—constructed in Blender and visualized in the Unity3D engine—achieving precise real‐time hand posture reproduction, necessary for visual feedback and sensor anomaly detection during sensor calibration and data collection by the operator. Furthermore, we evaluate the glove’s classification capability on a custom dataset of 15 objects. Through a grid search optimization, we trained One‐dimensional Convolutional Neural Network (CNN‐1D), Long‐Short Term Memory (LSTM), and Temporal Convolutional Network (TCN) architectures. The models achieved classification testing accuracies confidence intervals of [95.40%, 96.50%], [92.55%, 93.84%], and [93.47%, 94.76%], respectively, validating the high‐performance and utility of our multimodal sensing approach.
Förderung
- National Research Foundation
Zitieren
APA
Diakusala, J. A. N., Pan, Z., Kiveni, G. L., Chen, N., Bilal, H., Atemkeng, M., Bouwmans, T., Rahman, M. D. S., Ntokusi, A., Lalléchère, S., & Ravelo, B. (2026). Object Recognition Using Deep Learning‐Powered Glove With Flex and MPU Sensors Fusion. Journal of Robotics, 2026(1). https://doi.org/10.1155/joro/6642796
Vancouver
Diakusala JAN, Pan Z, Kiveni GL, Chen N, Bilal H, Atemkeng M, et al. Object Recognition Using Deep Learning‐Powered Glove With Flex and MPU Sensors Fusion. Journal of Robotics. 2026;2026(1). doi:10.1155/joro/6642796
BibTeX
@article{Diakusala2026,
author = {Diakusala, Joao Andre Ndombasi and Pan, Zhigeng and Kiveni, Ginias Lulendo and Chen, Nenglun and Bilal, Habachi and Atemkeng, Marcellin and Bouwmans, Thierry and Rahman, M. D. Sabbir and Ntokusi, Ange and Lalléchère, Sébastien and Ravelo, Blaise},
title = {Object Recognition Using Deep Learning‐Powered Glove With Flex and MPU Sensors Fusion},
journal = {Journal of Robotics},
year = {2026},
volume = {2026},
number = {1},
doi = {10.1155/joro/6642796}
}
EUVIMED