Multimodal Haptic Object Recognition: Can Kinesthetic Inference Compensate for the Lack of Tactile Sensing Resolution?
IEEE Sensors Journal · 01.06.2026 · 26 (11) · 17285-17293
DOI: 10.1109/jsen.2026.3684076 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Sensors Journal, erschienen am 01.06.2026. Verfasst von Francisco Pastor und 3 weiteren Autor:innen. Die Arbeit nennt 49 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: University of Málaga, Ministerio de Ciencia, Innovación y Universidades, Gobierno de España, CBUA.
Abstract (Originalsprache)
Haptic perception arises from the integration of cutaneous and kinesthetic cues, yet achieving human-level tactile performance in robotic systems remains technically demanding and economically costly. This raises a fundamental question: how much does spatial resolution truly matter for robotic touch, and can kinesthetic inference compensate when tactile resolution is limited? To investigate this, we conduct a study on haptic object recognition using an underactuated, sensorized gripper equipped with a high-resolution tactile array and joint angle sensors. We evaluate a dataset of 36 objects collected under a squeeze-and-release exploratory procedure (EP). Tactile sequences are downsampled to four resolutions (100%, 75%, 50%, and 25%) using bicubic interpolation, and ConvLSTM-based models are trained to quantify accuracy degradation as spatial detail decreases. We then use two fusion strategies from our previous work: Bayesian inference and neural-based inference, which combine tactile and kinesthetic modalities, and assess whether kinesthetic cues can offset the loss of tactile precision. The results quantify the performance drop as tactile resolution decreases and uncover promising evidence that multimodal fusion can partially recover this lost capability. Interestingly, the two fusion methods exhibit distinct behaviors in terms of robustness and consistency. As discussed comprehensively in the article, these findings suggest that, under the right conditions, reliable object recognition may not depend solely on maintaining high tactile resolution, opening new possibilities for designing more scalable and cost-efficient haptic perception systems.
Förderung
- University of Málaga, Ministerio de Ciencia, Innovación y Universidades, Gobierno de España
- CBUA
Zitieren
APA
Pastor, F., Lin-Yang, D., García-Cerezo, A. J., & Gandarias, J. M. (2026). Multimodal Haptic Object Recognition: Can Kinesthetic Inference Compensate for the Lack of Tactile Sensing Resolution?. IEEE Sensors Journal, 26(11), 17285-17293. https://doi.org/10.1109/jsen.2026.3684076
Vancouver
Pastor F, Lin-Yang D, García-Cerezo AJ, Gandarias JM. Multimodal Haptic Object Recognition: Can Kinesthetic Inference Compensate for the Lack of Tactile Sensing Resolution?. IEEE Sensors Journal. 2026;26(11):17285-17293. doi:10.1109/jsen.2026.3684076
BibTeX
@article{Pastor2026,
author = {Pastor, Francisco and Lin-Yang, Da-Hui and García-Cerezo, Alfonso J. and Gandarias, Juan M.},
title = {Multimodal Haptic Object Recognition: Can Kinesthetic Inference Compensate for the Lack of Tactile Sensing Resolution?},
journal = {IEEE Sensors Journal},
year = {2026},
volume = {26},
number = {11},
pages = {17285--17293},
doi = {10.1109/jsen.2026.3684076}
}
EUVIMED